[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:50 dist-test-slave-jlzn krb5kdc[16630](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:50 dist-test-slave-jlzn krb5kdc[16630](info): set up 2 sockets
Aug 10 01:41:50 dist-test-slave-jlzn krb5kdc[16630](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 01:41:51.331667 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:41:51 dist-test-slave-jlzn krb5kdc[16630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:41:51.449476 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35353
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:35353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:51.578979 16648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:51.579238 16648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:51.579298 16648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:51.583583 16648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:51.583654 16648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:51.583685 16648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:51.583707 16648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:51.583729 16648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:51.589586 16648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:35353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:51.590996 16648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:51.592327 16648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:41:51.606868 16648 server_base.cc:1034] running on GCE node
W20260810 01:41:51.606981 16654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:51.606819 16661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:51.607064 16656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:51.607926 16648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:51.609794 16648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:51.610962 16648 hybrid_clock.cc:648] HybridClock initialized: now 1786326111610933 us; error 48 us; skew 500 ppm
Aug 10 01:41:51 dist-test-slave-jlzn krb5kdc[16630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326111, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:51.613821 16648 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:41:51.614974 16648 webserver.cc:460] Webserver started at http://127.16.58.126:46541/ using document root <none> and password file <none>
I20260810 01:41:51.615948 16648 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:51.616021 16648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:51.616428 16648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:51.619149 16648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "d924a2d51fd948cabca4f3d53854d411"
format_stamp: "Formatted at 2026-08-10 01:41:51 on dist-test-slave-jlzn"
server_key: "d6f2e3ece4928e78032630e6ea1c031d"
server_key_iv: "0e75014ab25168e2eaae1b5478e0bef1"
server_key_version: "encryptionkey@0"
I20260810 01:41:51.619697 16648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "d924a2d51fd948cabca4f3d53854d411"
format_stamp: "Formatted at 2026-08-10 01:41:51 on dist-test-slave-jlzn"
server_key: "d6f2e3ece4928e78032630e6ea1c031d"
server_key_iv: "0e75014ab25168e2eaae1b5478e0bef1"
server_key_version: "encryptionkey@0"
I20260810 01:41:51.625193 16648 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260810 01:41:51.628880 16668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:51.630425 16648 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:41:51.630600 16648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "d924a2d51fd948cabca4f3d53854d411"
format_stamp: "Formatted at 2026-08-10 01:41:51 on dist-test-slave-jlzn"
server_key: "d6f2e3ece4928e78032630e6ea1c031d"
server_key_iv: "0e75014ab25168e2eaae1b5478e0bef1"
server_key_version: "encryptionkey@0"
I20260810 01:41:51.630707 16648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:51.645547 16648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:51.648806 16648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:51.649061 16648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:51.666347 16648 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:35353
I20260810 01:41:51.666432 16748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:35353 every 8 connection(s)
I20260810 01:41:51.667851 16648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:51.673147 16749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:51.677573 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 16648
I20260810 01:41:51.677713 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:41:51.679059 16617 external_mini_cluster.cc:1428] Setting key fcd8c9c6ceb8a452290c1accc0362937
I20260810 01:41:51.682648 16749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411: Bootstrap starting.
I20260810 01:41:51.687341 16749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:51.689144 16749 log.cc:824] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:51.691762 16749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411: No bootstrap required, opened a new log
I20260810 01:41:51.698029 16749 raft_consensus.cc:348] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d924a2d51fd948cabca4f3d53854d411" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35353 } }
I20260810 01:41:51.698323 16749 raft_consensus.cc:374] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:51.698412 16749 raft_consensus.cc:729] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d924a2d51fd948cabca4f3d53854d411, State: Initialized, Role: FOLLOWER
I20260810 01:41:51.699169 16749 consensus_queue.cc:260] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d924a2d51fd948cabca4f3d53854d411" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35353 } }
I20260810 01:41:51.699368 16749 raft_consensus.cc:388] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
Aug 10 01:41:51 dist-test-slave-jlzn krb5kdc[16630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:51.699498 16749 raft_consensus.cc:482] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:51.699644 16749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:51.700968 16749 raft_consensus.cc:504] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d924a2d51fd948cabca4f3d53854d411" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35353 } }
I20260810 01:41:51.701726 16749 leader_election.cc:302] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d924a2d51fd948cabca4f3d53854d411; no voters:
I20260810 01:41:51.702108 16749 leader_election.cc:288] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:51.702316 16759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:51.702644 16759 raft_consensus.cc:686] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [term 1 LEADER]: Becoming Leader. State: Replica: d924a2d51fd948cabca4f3d53854d411, State: Running, Role: LEADER
I20260810 01:41:51.703128 16759 consensus_queue.cc:237] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d924a2d51fd948cabca4f3d53854d411" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35353 } }
I20260810 01:41:51.703879 16749 sys_catalog.cc:564] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:51.706460 16764 sys_catalog.cc:455] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d924a2d51fd948cabca4f3d53854d411. Latest consensus state: current_term: 1 leader_uuid: "d924a2d51fd948cabca4f3d53854d411" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d924a2d51fd948cabca4f3d53854d411" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35353 } } }
I20260810 01:41:51.706604 16764 sys_catalog.cc:458] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:51.707166 16753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:51.686194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37248 (local address 127.16.58.126:35353)
0810 01:41:51.686756 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:51.686808 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:51.686884 (+ 76us) server_negotiation.cc:407] Connection header received
0810 01:41:51.689503 (+ 2619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:51.689528 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:51.689867 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:51.690150 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:51.692820 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:51.693969 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:51.695225 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:51.695833 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:51.695988 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:51.700338 (+ 4350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:51.700366 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:51.700378 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:51.700405 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:51.702680 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:51.703351 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:51.703357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:51.703362 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:51.703511 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:51.703962 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:51.703966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:51.703967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:51.704591 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:51.704779 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:51.705521 (+ 742us) server_negotiation.cc:299] Negotiation successful
0810 01:41:51.705793 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":167,"threads_started":1}
I20260810 01:41:51.707155 16763 sys_catalog.cc:455] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d924a2d51fd948cabca4f3d53854d411" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d924a2d51fd948cabca4f3d53854d411" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35353 } } }
I20260810 01:41:51.708117 16763 sys_catalog.cc:458] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:51.708379 16775 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:51.714047 16775 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:51.722358 16775 catalog_manager.cc:1347] Generated new cluster ID: b61dfb6047a941c0a5fca653c7b14691
I20260810 01:41:51.722421 16775 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:51.732352 16775 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:51.733193 16775 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:51.738348 16775 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d924a2d51fd948cabca4f3d53854d411: Generated new TSK 0
I20260810 01:41:51.739111 16775 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:41:51.772887 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35353
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:51.946645 16791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:51.946893 16791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:51.946940 16791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:51.951050 16791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:51.951103 16791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:51.951174 16791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:41:51.956894 16791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35353
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:51.957877 16791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:51.958849 16791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:51.970001 16796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:51.970055 16801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:51.970019 16798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:51.970335 16791 server_base.cc:1034] running on GCE node
I20260810 01:41:51.970696 16791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:51.971273 16791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:51.972424 16791 hybrid_clock.cc:648] HybridClock initialized: now 1786326111972409 us; error 25 us; skew 500 ppm
Aug 10 01:41:51 dist-test-slave-jlzn krb5kdc[16630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326111, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:51.975607 16791 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:41:51.976414 16791 webserver.cc:460] Webserver started at http://127.16.58.65:44945/ using document root <none> and password file <none>
I20260810 01:41:51.976894 16791 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:51.976950 16791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:51.977108 16791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:51.979213 16791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "6d947d505bbe4820ae13fbc933113f25"
format_stamp: "Formatted at 2026-08-10 01:41:51 on dist-test-slave-jlzn"
server_key: "0615d7d3d108a334bce74effb920d254"
server_key_iv: "8fe54e8686fba03da1cc07278e9a9b19"
server_key_version: "encryptionkey@0"
I20260810 01:41:51.979796 16791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "6d947d505bbe4820ae13fbc933113f25"
format_stamp: "Formatted at 2026-08-10 01:41:51 on dist-test-slave-jlzn"
server_key: "0615d7d3d108a334bce74effb920d254"
server_key_iv: "8fe54e8686fba03da1cc07278e9a9b19"
server_key_version: "encryptionkey@0"
I20260810 01:41:51.983371 16791 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:51.985769 16813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:51.986943 16791 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:51.987041 16791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "6d947d505bbe4820ae13fbc933113f25"
format_stamp: "Formatted at 2026-08-10 01:41:51 on dist-test-slave-jlzn"
server_key: "0615d7d3d108a334bce74effb920d254"
server_key_iv: "8fe54e8686fba03da1cc07278e9a9b19"
server_key_version: "encryptionkey@0"
I20260810 01:41:51.987143 16791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:52.011512 16791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:52.014842 16791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:52.015039 16791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:52.015884 16791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:52.017149 16791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:52.017203 16791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:52.017247 16791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:52.017277 16791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:52.038681 16791 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:34575
I20260810 01:41:52.038805 17012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:34575 every 8 connection(s)
I20260810 01:41:52.039624 16791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:41:52.040603 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 16791
I20260810 01:41:52.040727 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:41:52.041018 16617 external_mini_cluster.cc:1428] Setting key 2c3ffdf9fb22891e96cd64d5930af87e
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[16630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326111, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:41:52.054492 16753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:52.042084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:51959 (local address 127.16.58.126:35353)
0810 01:41:52.042214 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:52.042218 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:52.043657 (+ 1439us) server_negotiation.cc:407] Connection header received
0810 01:41:52.044816 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:52.044819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:52.044874 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:52.044944 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:52.046302 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.046820 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.048180 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.048407 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.048495 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:52.051304 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:52.051308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:52.051310 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:52.051334 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:52.052743 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.053225 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.053228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.053229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.053300 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.053560 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.053563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.053565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.053773 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:52.053855 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:52.054270 (+ 415us) server_negotiation.cc:299] Negotiation successful
0810 01:41:52.054373 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:41:52.055272 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:52.042532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35353 (local address 127.16.58.65:51959)
0810 01:41:52.043490 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:52.043553 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:52.044617 (+ 1064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:52.045124 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:52.045131 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:52.045556 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:52.046150 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:52.046166 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.046940 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.046942 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:52.048064 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:52.048075 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.048550 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.048555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:52.048743 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:52.049331 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:52.049347 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:52.051131 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:52.052861 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:52.052866 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:52.052879 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:52.053149 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:52.053363 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:52.053365 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:52.053366 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:52.053488 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:52.053855 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:52.053860 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:52.054087 (+ 227us) client_negotiation.cc:769] Sending connection context
0810 01:41:52.054232 (+ 145us) client_negotiation.cc:240] Negotiation successful
0810 01:41:52.054460 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":169,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
I20260810 01:41:52.056531 17013 heartbeater.cc:347] Connected to a master server at 127.16.58.126:35353
I20260810 01:41:52.056759 17013 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:52.057221 17013 heartbeater.cc:511] Master 127.16.58.126:35353 requested a full tablet report, sending...
I20260810 01:41:52.059144 16696 ts_manager.cc:194] Registered new tserver with Master: 6d947d505bbe4820ae13fbc933113f25 (127.16.58.65:34575)
I20260810 01:41:52.060613 16696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:51959
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:41:52.072007 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35353
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:52.213634 17023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:52.213853 17023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:52.213893 17023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:52.217777 17023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:52.217825 17023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:52.217880 17023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:41:52.222781 17023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35353
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:52.223713 17023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:52.224663 17023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:52.234014 17032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:52.234138 17035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:52.234143 17033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:52.234236 17023 server_base.cc:1034] running on GCE node
I20260810 01:41:52.234681 17023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:52.235284 17023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:52.236440 17023 hybrid_clock.cc:648] HybridClock initialized: now 1786326112236425 us; error 27 us; skew 500 ppm
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[16630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326112, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:52.239531 17023 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:41:52.240414 17023 webserver.cc:460] Webserver started at http://127.16.58.66:44509/ using document root <none> and password file <none>
I20260810 01:41:52.240913 17023 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:52.240979 17023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:52.241171 17023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:52.243054 17023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "726427cd7d8140379e5eea0b1c2b064c"
format_stamp: "Formatted at 2026-08-10 01:41:52 on dist-test-slave-jlzn"
server_key: "ebd10d6f2a0125ac3291e15d6691578a"
server_key_iv: "a25a182ba597451f347f59380406fce1"
server_key_version: "encryptionkey@0"
I20260810 01:41:52.243573 17023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "726427cd7d8140379e5eea0b1c2b064c"
format_stamp: "Formatted at 2026-08-10 01:41:52 on dist-test-slave-jlzn"
server_key: "ebd10d6f2a0125ac3291e15d6691578a"
server_key_iv: "a25a182ba597451f347f59380406fce1"
server_key_version: "encryptionkey@0"
I20260810 01:41:52.247084 17023 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260810 01:41:52.249334 17048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:52.250526 17023 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:41:52.250638 17023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "726427cd7d8140379e5eea0b1c2b064c"
format_stamp: "Formatted at 2026-08-10 01:41:52 on dist-test-slave-jlzn"
server_key: "ebd10d6f2a0125ac3291e15d6691578a"
server_key_iv: "a25a182ba597451f347f59380406fce1"
server_key_version: "encryptionkey@0"
I20260810 01:41:52.250727 17023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:52.265007 17023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:52.267795 17023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:52.267995 17023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:52.268522 17023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:52.269275 17023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:52.269323 17023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:52.269373 17023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:52.269398 17023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:52.279065 17023 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:46281
I20260810 01:41:52.279174 17248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:46281 every 8 connection(s)
I20260810 01:41:52.279935 17023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:41:52.287964 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17023
I20260810 01:41:52.288065 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:41:52.288292 16617 external_mini_cluster.cc:1428] Setting key c1fb2745002b0f8618bbcb774cbb7da0
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[16630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326112, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:52.293053 16753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:52.281579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:38365 (local address 127.16.58.126:35353)
0810 01:41:52.281703 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:52.281706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:52.283056 (+ 1350us) server_negotiation.cc:407] Connection header received
0810 01:41:52.283901 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:52.283905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:52.283964 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:52.284043 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:52.285127 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.285648 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.286752 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.286975 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.287103 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:52.289487 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:52.289491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:52.289494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:52.289525 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:52.290962 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.291436 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.291439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.291441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.291548 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.291953 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.291957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.291958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.292189 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:52.292280 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:52.292777 (+ 497us) server_negotiation.cc:299] Negotiation successful
0810 01:41:52.292898 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:41:52.293774 17254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:52.281903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35353 (local address 127.16.58.66:38365)
0810 01:41:52.282914 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:52.282954 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:52.283691 (+ 737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:52.284212 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:52.284218 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:52.284539 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:52.284975 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:52.284987 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.285769 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.285772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:52.286618 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:52.286638 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.287126 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.287130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:52.287306 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:52.287777 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:52.287792 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:52.289330 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:52.291083 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:52.291089 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:52.291101 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:52.291345 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:52.291663 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:52.291666 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:52.291668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:52.291853 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:52.292290 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:52.292296 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:52.292521 (+ 225us) client_negotiation.cc:769] Sending connection context
0810 01:41:52.292695 (+ 174us) client_negotiation.cc:240] Negotiation successful
0810 01:41:52.292992 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"thread_start_us":692,"threads_started":1}
I20260810 01:41:52.294912 17249 heartbeater.cc:347] Connected to a master server at 127.16.58.126:35353
I20260810 01:41:52.295125 17249 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:52.295568 17249 heartbeater.cc:511] Master 127.16.58.126:35353 requested a full tablet report, sending...
I20260810 01:41:52.296651 16696 ts_manager.cc:194] Registered new tserver with Master: 726427cd7d8140379e5eea0b1c2b064c (127.16.58.66:46281)
I20260810 01:41:52.297191 16696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:38365
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:41:52.315876 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35353
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:37357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:52.424074 17261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:52.424300 17261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:52.424346 17261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:52.428215 17261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:52.428263 17261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:52.428334 17261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:41:52.433243 17261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:37357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35353
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:52.434322 17261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:52.435292 17261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:52.444448 17269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:52.444519 17271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:52.444489 17275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:52.444643 17261 server_base.cc:1034] running on GCE node
I20260810 01:41:52.445034 17261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:52.445595 17261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:52.446761 17261 hybrid_clock.cc:648] HybridClock initialized: now 1786326112446748 us; error 25 us; skew 500 ppm
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[16630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326112, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:52.449340 17261 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:41:52.450107 17261 webserver.cc:460] Webserver started at http://127.16.58.67:43871/ using document root <none> and password file <none>
I20260810 01:41:52.450634 17261 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:52.450693 17261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:52.450850 17261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:52.452726 17261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "ad82a4d650924b779325aae860928ea0"
format_stamp: "Formatted at 2026-08-10 01:41:52 on dist-test-slave-jlzn"
server_key: "442cacb2fa6f661bef3a35f5a0150127"
server_key_iv: "9a4f287d3223f2470ee3fb2ed20f7d1b"
server_key_version: "encryptionkey@0"
I20260810 01:41:52.453248 17261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "ad82a4d650924b779325aae860928ea0"
format_stamp: "Formatted at 2026-08-10 01:41:52 on dist-test-slave-jlzn"
server_key: "442cacb2fa6f661bef3a35f5a0150127"
server_key_iv: "9a4f287d3223f2470ee3fb2ed20f7d1b"
server_key_version: "encryptionkey@0"
I20260810 01:41:52.456664 17261 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:41:52.458778 17289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:52.459916 17261 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:41:52.460018 17261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "ad82a4d650924b779325aae860928ea0"
format_stamp: "Formatted at 2026-08-10 01:41:52 on dist-test-slave-jlzn"
server_key: "442cacb2fa6f661bef3a35f5a0150127"
server_key_iv: "9a4f287d3223f2470ee3fb2ed20f7d1b"
server_key_version: "encryptionkey@0"
I20260810 01:41:52.460112 17261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:52.478971 17261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:52.481864 17261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:52.482023 17261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:52.482551 17261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:52.483332 17261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:52.483378 17261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:52.483418 17261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:52.483446 17261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:52.491833 17261 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:40257
I20260810 01:41:52.491890 17462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:40257 every 8 connection(s)
I20260810 01:41:52.492650 17261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[16630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326112, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:52.501194 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17261
I20260810 01:41:52.501308 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:41:52.501539 16617 external_mini_cluster.cc:1428] Setting key 6e068698d0454c31c5101fdf8a3f2b0d
I20260810 01:41:52.505275 16753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:52.494318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:55977 (local address 127.16.58.126:35353)
0810 01:41:52.494438 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:52.494442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:52.495373 (+ 931us) server_negotiation.cc:407] Connection header received
0810 01:41:52.496228 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:52.496232 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:52.496288 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:52.496361 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:52.497436 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.497957 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.499042 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.499280 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.499369 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:52.501705 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:52.501707 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:52.501709 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:52.501734 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:52.503072 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.503503 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.503506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.503508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.503606 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.504192 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.504195 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.504197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.504401 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:52.504488 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:52.504979 (+ 491us) server_negotiation.cc:299] Negotiation successful
0810 01:41:52.505114 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:41:52.505946 17467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:52.494640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35353 (local address 127.16.58.67:55977)
0810 01:41:52.495239 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:52.495276 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:52.496030 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:52.496528 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:52.496535 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:52.496866 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:52.497291 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:52.497303 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.498073 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.498076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:52.498918 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:52.498928 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.499415 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.499420 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:52.499569 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:52.500085 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:52.500101 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:52.501527 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:52.503167 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:52.503172 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:52.503182 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:52.503415 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:52.503702 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:52.503705 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:52.503706 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:52.504100 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:52.504500 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:52.504506 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:52.504735 (+ 229us) client_negotiation.cc:769] Sending connection context
0810 01:41:52.504901 (+ 166us) client_negotiation.cc:240] Negotiation successful
0810 01:41:52.505190 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":108,"threads_started":1}
I20260810 01:41:52.506932 17463 heartbeater.cc:347] Connected to a master server at 127.16.58.126:35353
I20260810 01:41:52.507124 17463 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:52.507545 17463 heartbeater.cc:511] Master 127.16.58.126:35353 requested a full tablet report, sending...
I20260810 01:41:52.508460 16696 ts_manager.cc:194] Registered new tserver with Master: ad82a4d650924b779325aae860928ea0 (127.16.58.67:40257)
I20260810 01:41:52.508960 16696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:55977
I20260810 01:41:52.515475 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[16630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326112, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[16630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326112, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:41:52.541079 17476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:52.532150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36364 (local address 127.16.58.65:34575)
0810 01:41:52.532441 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:52.532454 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:52.532475 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:41:52.532520 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:52.532524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:52.532686 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:52.532792 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:52.533364 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.534111 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.534943 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.535288 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.535366 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:52.538002 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:52.538012 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:52.538023 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:52.538046 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:52.539503 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.539899 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.539903 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.539904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.539983 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.540198 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.540200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.540201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.540441 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:52.540592 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:52.540793 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 01:41:52.540914 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":110,"threads_started":1}
W20260810 01:41:52.542073 16860 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36364
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[16630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[16630](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:41:52.565160 17476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:52.558072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36366 (local address 127.16.58.65:34575)
0810 01:41:52.558204 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:52.558208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:52.558304 (+ 96us) server_negotiation.cc:407] Connection header received
0810 01:41:52.558427 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:52.558431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:52.558469 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:52.558531 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:52.559150 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.559628 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.560442 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:52.560667 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:52.560753 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:52.562771 (+ 2018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:52.562774 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:52.562776 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:52.562798 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:52.563947 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.564286 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.564288 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.564289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.564355 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:52.564551 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:52.564555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:52.564557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:52.564711 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:52.564808 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:52.564963 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 01:41:52.565053 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:41:52.566051 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 16791
I20260810 01:41:52.578678 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17023
I20260810 01:41:52.592170 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17261
I20260810 01:41:52.599164 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 16648
2026-08-10T01:41:52Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2418 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[17486](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[17486](info): set up 2 sockets
Aug 10 01:41:52 dist-test-slave-jlzn krb5kdc[17486](info): commencing operation
krb5kdc: starting...
W20260810 01:41:53.728945 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:41:53 dist-test-slave-jlzn krb5kdc[17486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:41:53.842278 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:33505
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:34427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:33505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:53.948737 17503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:53.948987 17503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:53.949050 17503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:53.952935 17503 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:53.952987 17503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:53.953013 17503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:53.953042 17503 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:53.953073 17503 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:53.958158 17503 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:34427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:33505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:33505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:53.959084 17503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:53.960049 17503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:53.967900 17515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:53.967886 17510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:53.967931 17503 server_base.cc:1034] running on GCE node
W20260810 01:41:53.967888 17512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:53.968721 17503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:53.969718 17503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:53.970873 17503 hybrid_clock.cc:648] HybridClock initialized: now 1786326113970859 us; error 26 us; skew 500 ppm
Aug 10 01:41:53 dist-test-slave-jlzn krb5kdc[17486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326113, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:53.973498 17503 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:41:53.974320 17503 webserver.cc:460] Webserver started at http://127.16.58.126:38373/ using document root <none> and password file <none>
I20260810 01:41:53.974820 17503 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:53.974885 17503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:53.975080 17503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:53.976984 17503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "3a549039dc8e479b85b43d30317cfc3c"
format_stamp: "Formatted at 2026-08-10 01:41:53 on dist-test-slave-jlzn"
server_key: "bcbfe48e5b15d5dc1b78631259d21d14"
server_key_iv: "a1f9f43ffb9feff94e90318ffd859b50"
server_key_version: "encryptionkey@0"
I20260810 01:41:53.977491 17503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "3a549039dc8e479b85b43d30317cfc3c"
format_stamp: "Formatted at 2026-08-10 01:41:53 on dist-test-slave-jlzn"
server_key: "bcbfe48e5b15d5dc1b78631259d21d14"
server_key_iv: "a1f9f43ffb9feff94e90318ffd859b50"
server_key_version: "encryptionkey@0"
I20260810 01:41:53.980858 17503 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260810 01:41:53.983023 17530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:53.984143 17503 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:41:53.984252 17503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "3a549039dc8e479b85b43d30317cfc3c"
format_stamp: "Formatted at 2026-08-10 01:41:53 on dist-test-slave-jlzn"
server_key: "bcbfe48e5b15d5dc1b78631259d21d14"
server_key_iv: "a1f9f43ffb9feff94e90318ffd859b50"
server_key_version: "encryptionkey@0"
I20260810 01:41:53.984342 17503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:54.007115 17503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:54.009686 17503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:54.009852 17503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:54.016395 17503 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:33505
I20260810 01:41:54.016412 17618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:33505 every 8 connection(s)
I20260810 01:41:54.017277 17503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:54.019892 17619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:54.025108 17619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c: Bootstrap starting.
I20260810 01:41:54.027168 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17503
I20260810 01:41:54.027261 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:41:54.027477 16617 external_mini_cluster.cc:1428] Setting key 9695cea4713ffff63152493873f8373e
I20260810 01:41:54.027489 17619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:54.028311 17619 log.cc:824] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:54.030062 17619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c: No bootstrap required, opened a new log
I20260810 01:41:54.034392 17619 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a549039dc8e479b85b43d30317cfc3c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 33505 } }
I20260810 01:41:54.034662 17619 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:54.034723 17619 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a549039dc8e479b85b43d30317cfc3c, State: Initialized, Role: FOLLOWER
I20260810 01:41:54.035197 17619 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a549039dc8e479b85b43d30317cfc3c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 33505 } }
I20260810 01:41:54.035329 17619 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:54.035388 17619 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:54.035480 17619 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [term 0 FOLLOWER]: Advancing to term 1
Aug 10 01:41:54 dist-test-slave-jlzn krb5kdc[17486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:54.036419 17619 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a549039dc8e479b85b43d30317cfc3c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 33505 } }
I20260810 01:41:54.036778 17619 leader_election.cc:302] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a549039dc8e479b85b43d30317cfc3c; no voters:
I20260810 01:41:54.037137 17619 leader_election.cc:288] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:54.037300 17626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:54.037485 17626 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [term 1 LEADER]: Becoming Leader. State: Replica: 3a549039dc8e479b85b43d30317cfc3c, State: Running, Role: LEADER
I20260810 01:41:54.037814 17626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a549039dc8e479b85b43d30317cfc3c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 33505 } }
I20260810 01:41:54.038447 17619 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:54.039206 17627 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a549039dc8e479b85b43d30317cfc3c. Latest consensus state: current_term: 1 leader_uuid: "3a549039dc8e479b85b43d30317cfc3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a549039dc8e479b85b43d30317cfc3c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 33505 } } }
I20260810 01:41:54.040028 17627 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:54.039886 17628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a549039dc8e479b85b43d30317cfc3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a549039dc8e479b85b43d30317cfc3c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 33505 } } }
I20260810 01:41:54.040490 17628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:54.040787 17646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:54.041567 17625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.028465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34438 (local address 127.16.58.126:33505)
0810 01:41:54.028858 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:54.028873 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:54.028904 (+ 31us) server_negotiation.cc:407] Connection header received
0810 01:41:54.029493 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:54.029508 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:54.029800 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:54.030045 (+ 245us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:54.030884 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.031854 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.032988 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.033430 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.033557 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.036245 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:54.036251 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:54.036267 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:54.036298 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:54.038105 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.038621 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.038627 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.038633 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.038796 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.039121 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.039124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.039126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.039600 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:54.039776 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:54.040491 (+ 715us) server_negotiation.cc:299] Negotiation successful
0810 01:41:54.040774 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":119,"threads_started":1}
I20260810 01:41:54.043820 17646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:54.048885 17646 catalog_manager.cc:1347] Generated new cluster ID: f70b2eaa95444951841d2d4471dfb025
I20260810 01:41:54.048949 17646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:54.059013 17646 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:54.059861 17646 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:54.068749 17646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a549039dc8e479b85b43d30317cfc3c: Generated new TSK 0
I20260810 01:41:54.069293 17646 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:41:54.100035 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:33505
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:34427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:54.218264 17657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:54.218506 17657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:54.218565 17657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:54.222455 17657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:54.222505 17657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:54.222559 17657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:41:54.227557 17657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:34427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:33505
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:54.228451 17657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:54.229321 17657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:54.238282 17664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:54.238327 17657 server_base.cc:1034] running on GCE node
W20260810 01:41:54.238243 17665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:54.238238 17669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:54.238811 17657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:54.239478 17657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:54.240644 17657 hybrid_clock.cc:648] HybridClock initialized: now 1786326114240629 us; error 25 us; skew 500 ppm
Aug 10 01:41:54 dist-test-slave-jlzn krb5kdc[17486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326114, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:54.243208 17657 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:41:54.244059 17657 webserver.cc:460] Webserver started at http://127.16.58.65:41401/ using document root <none> and password file <none>
I20260810 01:41:54.244560 17657 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:54.244633 17657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:54.244830 17657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:54.246800 17657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "a205acd98cb54f94841d40832b8fdad5"
format_stamp: "Formatted at 2026-08-10 01:41:54 on dist-test-slave-jlzn"
server_key: "456b5e5e05c381acced53c9961a05652"
server_key_iv: "c57c0a6961739ebf73290b0eb730910b"
server_key_version: "encryptionkey@0"
I20260810 01:41:54.247329 17657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "a205acd98cb54f94841d40832b8fdad5"
format_stamp: "Formatted at 2026-08-10 01:41:54 on dist-test-slave-jlzn"
server_key: "456b5e5e05c381acced53c9961a05652"
server_key_iv: "c57c0a6961739ebf73290b0eb730910b"
server_key_version: "encryptionkey@0"
I20260810 01:41:54.250741 17657 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:41:54.252981 17677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:54.254032 17657 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:41:54.254139 17657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "a205acd98cb54f94841d40832b8fdad5"
format_stamp: "Formatted at 2026-08-10 01:41:54 on dist-test-slave-jlzn"
server_key: "456b5e5e05c381acced53c9961a05652"
server_key_iv: "c57c0a6961739ebf73290b0eb730910b"
server_key_version: "encryptionkey@0"
I20260810 01:41:54.254228 17657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:54.294664 17657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:54.297412 17657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:54.297591 17657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:54.298166 17657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:54.298969 17657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:54.299017 17657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:54.299069 17657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:54.299098 17657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:54.307255 17657 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:42015
I20260810 01:41:54.307283 17857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:42015 every 8 connection(s)
I20260810 01:41:54.308091 17657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:41:54.316283 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17657
I20260810 01:41:54.316395 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:41:54.316684 16617 external_mini_cluster.cc:1428] Setting key 6f4174742fe9ab86e4ff16b34b8a7c78
Aug 10 01:41:54 dist-test-slave-jlzn krb5kdc[17486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326114, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:54.321485 17625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.309733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:43431 (local address 127.16.58.126:33505)
0810 01:41:54.309868 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:54.309872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:54.310654 (+ 782us) server_negotiation.cc:407] Connection header received
0810 01:41:54.312179 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:54.312183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:54.312240 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:54.312311 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:54.313436 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.313965 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.315090 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.315358 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.315459 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.318216 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:54.318219 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:54.318221 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:54.318244 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:54.319425 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.320026 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.320030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.320032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.320127 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.320445 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.320448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.320450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.320682 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:54.320771 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:54.321212 (+ 441us) server_negotiation.cc:299] Negotiation successful
0810 01:41:54.321336 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:41:54.322149 17861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.310076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:33505 (local address 127.16.58.65:43431)
0810 01:41:54.310515 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:54.310556 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:54.311961 (+ 1405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:54.312481 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:54.312487 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:54.312839 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:54.313286 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.313300 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.314086 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.314088 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.314966 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.314976 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.315531 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.315535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.315735 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.316383 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:54.316404 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:54.318044 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:54.319534 (+ 1490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:54.319540 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:54.319554 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:54.319928 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:54.320227 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:54.320230 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:54.320231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:54.320361 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:54.320772 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:54.320777 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:54.320983 (+ 206us) client_negotiation.cc:769] Sending connection context
0810 01:41:54.321120 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 01:41:54.321352 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":111,"threads_started":1}
I20260810 01:41:54.323290 17859 heartbeater.cc:347] Connected to a master server at 127.16.58.126:33505
I20260810 01:41:54.323539 17859 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:54.324178 17859 heartbeater.cc:511] Master 127.16.58.126:33505 requested a full tablet report, sending...
I20260810 01:41:54.325721 17556 ts_manager.cc:194] Registered new tserver with Master: a205acd98cb54f94841d40832b8fdad5 (127.16.58.65:42015)
I20260810 01:41:54.326833 17556 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:43431
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:41:54.344802 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:33505
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:34427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:54.454578 17865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:54.454788 17865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:54.454830 17865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:54.458772 17865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:54.458825 17865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:54.458892 17865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:41:54.463856 17865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:34427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:33505
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:54.464733 17865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:54.465612 17865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:54.474351 17877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:54.474328 17871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:54.474336 17874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:54.474617 17865 server_base.cc:1034] running on GCE node
I20260810 01:41:54.474948 17865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:54.475482 17865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:54.476630 17865 hybrid_clock.cc:648] HybridClock initialized: now 1786326114476608 us; error 35 us; skew 500 ppm
Aug 10 01:41:54 dist-test-slave-jlzn krb5kdc[17486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326114, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:54.479081 17865 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:41:54.479861 17865 webserver.cc:460] Webserver started at http://127.16.58.66:44303/ using document root <none> and password file <none>
I20260810 01:41:54.480329 17865 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:54.480386 17865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:54.480553 17865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:54.482324 17865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "edbd61fcd8e4451d8544b84926445dab"
format_stamp: "Formatted at 2026-08-10 01:41:54 on dist-test-slave-jlzn"
server_key: "b67abb761b182f2664f9a31dd0e32ede"
server_key_iv: "0cbe7879815d3f65b52dea121831dcea"
server_key_version: "encryptionkey@0"
I20260810 01:41:54.482838 17865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "edbd61fcd8e4451d8544b84926445dab"
format_stamp: "Formatted at 2026-08-10 01:41:54 on dist-test-slave-jlzn"
server_key: "b67abb761b182f2664f9a31dd0e32ede"
server_key_iv: "0cbe7879815d3f65b52dea121831dcea"
server_key_version: "encryptionkey@0"
I20260810 01:41:54.486181 17865 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 01:41:54.488511 17887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:54.489599 17865 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:41:54.489715 17865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "edbd61fcd8e4451d8544b84926445dab"
format_stamp: "Formatted at 2026-08-10 01:41:54 on dist-test-slave-jlzn"
server_key: "b67abb761b182f2664f9a31dd0e32ede"
server_key_iv: "0cbe7879815d3f65b52dea121831dcea"
server_key_version: "encryptionkey@0"
I20260810 01:41:54.489807 17865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:54.516175 17865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:54.518584 17865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:54.518746 17865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:54.519271 17865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:54.520089 17865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:54.520138 17865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:54.520190 17865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:54.520217 17865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:54.528450 17865 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:35693
I20260810 01:41:54.528475 18078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:35693 every 8 connection(s)
I20260810 01:41:54.529253 17865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:41:54.530639 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17865
I20260810 01:41:54.530751 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:41:54.531042 16617 external_mini_cluster.cc:1428] Setting key 9c50915c3132050c4ed38937fac904f4
Aug 10 01:41:54 dist-test-slave-jlzn krb5kdc[17486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326114, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:41:54.543573 17625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.530944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:54007 (local address 127.16.58.126:33505)
0810 01:41:54.531062 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:54.531066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:54.532078 (+ 1012us) server_negotiation.cc:407] Connection header received
0810 01:41:54.533408 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:54.533411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:54.533462 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:54.533546 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:54.534708 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.535222 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.536772 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.536979 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.537062 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.539988 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:54.539991 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:54.539993 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:54.540029 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:54.541687 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.542239 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.542243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.542244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.542319 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.542573 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.542575 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.542576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.542733 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:54.542812 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:54.543291 (+ 479us) server_negotiation.cc:299] Negotiation successful
0810 01:41:54.543402 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
I20260810 01:41:54.544464 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.531400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:33505 (local address 127.16.58.66:54007)
0810 01:41:54.531919 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:54.531975 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:54.533203 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:54.533685 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:54.533691 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:54.534017 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:54.534553 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.534572 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.535337 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.535341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.536669 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.536680 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.537149 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.537155 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.537349 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.537900 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:54.537921 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:54.539835 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:54.541804 (+ 1969us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:54.541810 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:54.541825 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:54.542146 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:54.542383 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:54.542385 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:54.542386 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:54.542506 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:54.542838 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:54.542844 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:54.543066 (+ 222us) client_negotiation.cc:769] Sending connection context
0810 01:41:54.543213 (+ 147us) client_negotiation.cc:240] Negotiation successful
0810 01:41:54.543506 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":122,"threads_started":1}
I20260810 01:41:54.545562 18079 heartbeater.cc:347] Connected to a master server at 127.16.58.126:33505
I20260810 01:41:54.545776 18079 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:54.546222 18079 heartbeater.cc:511] Master 127.16.58.126:33505 requested a full tablet report, sending...
I20260810 01:41:54.547191 17556 ts_manager.cc:194] Registered new tserver with Master: edbd61fcd8e4451d8544b84926445dab (127.16.58.66:35693)
I20260810 01:41:54.547719 17556 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:54007
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:41:54.557816 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:33505
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:34427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:54.664518 18085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:54.664736 18085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:54.664784 18085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:54.668653 18085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:54.668701 18085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:54.668771 18085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:41:54.673683 18085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:34427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:33505
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:54.674556 18085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:54.675402 18085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:54.684051 18090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:54.684078 18085 server_base.cc:1034] running on GCE node
W20260810 01:41:54.684041 18094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:54.684046 18092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:54.684607 18085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:54.685163 18085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:54.686317 18085 hybrid_clock.cc:648] HybridClock initialized: now 1786326114686303 us; error 24 us; skew 500 ppm
Aug 10 01:41:54 dist-test-slave-jlzn krb5kdc[17486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326114, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:54.688930 18085 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:41:54.689690 18085 webserver.cc:460] Webserver started at http://127.16.58.67:45453/ using document root <none> and password file <none>
I20260810 01:41:54.690168 18085 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:54.690232 18085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:54.690405 18085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:54.692314 18085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "2fdb85754f2c4d389004e86abad4d739"
format_stamp: "Formatted at 2026-08-10 01:41:54 on dist-test-slave-jlzn"
server_key: "56a64c3d861c9de088e47e1a690dac0c"
server_key_iv: "831ac69462d72fc1c5402ccf80945c61"
server_key_version: "encryptionkey@0"
I20260810 01:41:54.692837 18085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "2fdb85754f2c4d389004e86abad4d739"
format_stamp: "Formatted at 2026-08-10 01:41:54 on dist-test-slave-jlzn"
server_key: "56a64c3d861c9de088e47e1a690dac0c"
server_key_iv: "831ac69462d72fc1c5402ccf80945c61"
server_key_version: "encryptionkey@0"
I20260810 01:41:54.696151 18085 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:41:54.698272 18106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:54.699323 18085 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:54.699425 18085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "2fdb85754f2c4d389004e86abad4d739"
format_stamp: "Formatted at 2026-08-10 01:41:54 on dist-test-slave-jlzn"
server_key: "56a64c3d861c9de088e47e1a690dac0c"
server_key_iv: "831ac69462d72fc1c5402ccf80945c61"
server_key_version: "encryptionkey@0"
I20260810 01:41:54.699509 18085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:54.718853 18085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:54.721318 18085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:54.721479 18085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:54.721995 18085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:41:54.722735 18085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:54.722783 18085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:54.722834 18085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:54.722862 18085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:54.730780 18085 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:42439
I20260810 01:41:54.730809 18272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:42439 every 8 connection(s)
I20260810 01:41:54.731567 18085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:41:54.733215 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18085
I20260810 01:41:54.733338 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:41:54.733644 16617 external_mini_cluster.cc:1428] Setting key 7c8c6617ac36b7caa2ce543043278626
Aug 10 01:41:54 dist-test-slave-jlzn krb5kdc[17486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326114, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:54.743588 17625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.733175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:47601 (local address 127.16.58.126:33505)
0810 01:41:54.733322 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:54.733327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:54.734102 (+ 775us) server_negotiation.cc:407] Connection header received
0810 01:41:54.735295 (+ 1193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:54.735298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:54.735349 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:54.735431 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:54.736546 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.737072 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.738143 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.738359 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.738435 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.740714 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:54.740717 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:54.740719 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:54.740744 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:54.741974 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.742378 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.742381 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.742382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.742455 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.742717 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.742719 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.742720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.742874 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:54.742945 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:54.743359 (+ 414us) server_negotiation.cc:299] Negotiation successful
0810 01:41:54.743452 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 01:41:54.744365 18277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.733516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:33505 (local address 127.16.58.67:47601)
0810 01:41:54.733969 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:54.734016 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:54.735115 (+ 1099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:54.735594 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:54.735600 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:54.735975 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:54.736398 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.736411 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.737164 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.737167 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.738048 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.738058 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.738468 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.738471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.738599 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.739153 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:54.739169 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:54.740574 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:54.742060 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:54.742064 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:54.742073 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:54.742305 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:54.742526 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:54.742528 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:54.742530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:54.742651 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:54.742945 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:54.742949 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:54.743150 (+ 201us) client_negotiation.cc:769] Sending connection context
0810 01:41:54.743287 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 01:41:54.743499 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":118,"threads_started":1}
I20260810 01:41:54.745359 18274 heartbeater.cc:347] Connected to a master server at 127.16.58.126:33505
I20260810 01:41:54.745550 18274 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:54.745976 18274 heartbeater.cc:511] Master 127.16.58.126:33505 requested a full tablet report, sending...
I20260810 01:41:54.746948 17556 ts_manager.cc:194] Registered new tserver with Master: 2fdb85754f2c4d389004e86abad4d739 (127.16.58.67:42439)
I20260810 01:41:54.747500 17556 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:47601
I20260810 01:41:54.758663 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:41:54.768498 17625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.762544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34440 (local address 127.16.58.126:33505)
0810 01:41:54.762653 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:54.762656 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:54.762790 (+ 134us) server_negotiation.cc:407] Connection header received
0810 01:41:54.762898 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:54.762900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:54.762936 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:54.762989 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:54.763587 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.764107 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.764841 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.765035 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.765098 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.766182 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:54.766185 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:54.766187 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:54.766209 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:54.767250 (+ 1041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.767591 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.767592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.767594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.767663 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:54.767864 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:54.767866 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:54.767867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:54.768045 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:54.768144 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:54.768312 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 01:41:54.768392 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 01:41:54.773519 17556 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34440:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:41:54.776932 17556 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:41:54.791734 18295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.786083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:35693 (local address 127.0.0.1:51542)
0810 01:41:54.786363 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:54.786411 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:54.786526 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:54.787382 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:54.787388 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:54.787411 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:54.787538 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.787545 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.789077 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.789080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.790143 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.790154 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.791183 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.791187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.791295 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.791335 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 01:41:54.791456 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 01:41:54.791587 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":117,"threads_started":1}
I20260810 01:41:54.791745 18296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.786579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51542 (local address 127.16.58.66:35693)
0810 01:41:54.786903 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:54.786915 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:54.786939 (+ 24us) server_negotiation.cc:407] Connection header received
0810 01:41:54.787016 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:54.787022 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:54.787224 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:54.787380 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:54.787662 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.788944 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.790273 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.791051 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.791168 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.791364 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:54.791482 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 01:41:54.791590 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":113,"threads_started":1}
I20260810 01:41:54.792011 18293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.785941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42015 (local address 127.0.0.1:33286)
0810 01:41:54.786363 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:54.786409 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:54.786622 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:54.787784 (+ 1162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:54.787787 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:54.787835 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:54.787932 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.787939 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.789350 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.789353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.790611 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.790617 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.791522 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.791525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.791609 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.791630 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:41:54.791679 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 01:41:54.791732 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":29,"thread_start_us":70,"threads_started":1}
I20260810 01:41:54.792048 18297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.786608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:42439 (local address 127.0.0.1:46638)
0810 01:41:54.786852 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:54.786865 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:54.786983 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:54.788214 (+ 1231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:54.788217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:54.788234 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:54.788322 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.788328 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.789426 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.789430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.790605 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:54.790616 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.791650 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.791654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:54.791741 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.791767 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:41:54.791840 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 01:41:54.791916 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":7,"thread_start_us":106,"threads_started":1}
I20260810 01:41:54.792259 18298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.786940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33286 (local address 127.16.58.65:42015)
0810 01:41:54.787350 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:54.787364 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:54.787384 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:41:54.787456 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:54.787460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:54.787633 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:54.788080 (+ 447us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:54.788241 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.789234 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.790763 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.791386 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.791831 (+ 445us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.791972 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:54.792023 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 01:41:54.792113 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":115,"threads_started":1}
I20260810 01:41:54.792589 18299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:54.787339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46638 (local address 127.16.58.67:42439)
0810 01:41:54.787823 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:54.787836 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:54.787856 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:41:54.787915 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:54.787918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:54.788084 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:54.788212 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:54.788415 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.789254 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.790731 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:54.791505 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:54.792145 (+ 640us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:54.792273 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:54.792320 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 01:41:54.792395 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":119,"threads_started":1}
I20260810 01:41:54.795469 17976 tablet_service.cc:1467] Processing CreateTablet for tablet 5edd92cc4c494e06ba1c6c38d342b30a (DEFAULT_TABLE table=test-table [id=41925d3247624c16a0233a5e311e7da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:54.795469 18176 tablet_service.cc:1467] Processing CreateTablet for tablet 5edd92cc4c494e06ba1c6c38d342b30a (DEFAULT_TABLE table=test-table [id=41925d3247624c16a0233a5e311e7da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:54.796644 18176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5edd92cc4c494e06ba1c6c38d342b30a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:54.796880 17758 tablet_service.cc:1467] Processing CreateTablet for tablet 5edd92cc4c494e06ba1c6c38d342b30a (DEFAULT_TABLE table=test-table [id=41925d3247624c16a0233a5e311e7da3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:54.797950 17758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5edd92cc4c494e06ba1c6c38d342b30a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:54.798169 17976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5edd92cc4c494e06ba1c6c38d342b30a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:54.803979 18300 tablet_bootstrap.cc:492] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5: Bootstrap starting.
I20260810 01:41:54.805934 18302 tablet_bootstrap.cc:492] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739: Bootstrap starting.
I20260810 01:41:54.805980 18300 tablet_bootstrap.cc:654] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:54.806483 18301 tablet_bootstrap.cc:492] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab: Bootstrap starting.
I20260810 01:41:54.807441 18300 log.cc:824] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:54.808045 18302 tablet_bootstrap.cc:654] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:54.809106 18301 tablet_bootstrap.cc:654] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:54.809293 18302 log.cc:824] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:54.809386 18300 tablet_bootstrap.cc:492] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5: No bootstrap required, opened a new log
I20260810 01:41:54.809569 18300 ts_tablet_manager.cc:1397] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:41:54.809895 18301 log.cc:824] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:54.811165 18302 tablet_bootstrap.cc:492] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739: No bootstrap required, opened a new log
I20260810 01:41:54.811354 18302 ts_tablet_manager.cc:1397] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:41:54.811842 18301 tablet_bootstrap.cc:492] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab: No bootstrap required, opened a new log
I20260810 01:41:54.812023 18301 ts_tablet_manager.cc:1397] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:41:54.812726 18300 raft_consensus.cc:348] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } }
I20260810 01:41:54.812933 18300 raft_consensus.cc:374] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:54.813004 18300 raft_consensus.cc:729] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a205acd98cb54f94841d40832b8fdad5, State: Initialized, Role: FOLLOWER
I20260810 01:41:54.813405 18300 consensus_queue.cc:260] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } }
I20260810 01:41:54.814121 17859 heartbeater.cc:503] Master 127.16.58.126:33505 was elected leader, sending a full tablet report...
I20260810 01:41:54.815184 18300 ts_tablet_manager.cc:1428] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:41:54.815096 18302 raft_consensus.cc:348] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } }
I20260810 01:41:54.815384 18302 raft_consensus.cc:374] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:54.815450 18302 raft_consensus.cc:729] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fdb85754f2c4d389004e86abad4d739, State: Initialized, Role: FOLLOWER
I20260810 01:41:54.815583 18301 raft_consensus.cc:348] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } }
I20260810 01:41:54.815845 18301 raft_consensus.cc:374] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:54.815945 18301 raft_consensus.cc:729] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edbd61fcd8e4451d8544b84926445dab, State: Initialized, Role: FOLLOWER
I20260810 01:41:54.815925 18302 consensus_queue.cc:260] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } }
I20260810 01:41:54.816367 18301 consensus_queue.cc:260] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } }
I20260810 01:41:54.816556 18274 heartbeater.cc:503] Master 127.16.58.126:33505 was elected leader, sending a full tablet report...
I20260810 01:41:54.816893 18302 ts_tablet_manager.cc:1428] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:41:54.817293 18079 heartbeater.cc:503] Master 127.16.58.126:33505 was elected leader, sending a full tablet report...
I20260810 01:41:54.817308 18301 ts_tablet_manager.cc:1428] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
W20260810 01:41:54.982529 18275 tablet.cc:2369] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:41:55.030308 18081 tablet.cc:2369] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:41:55.059293 17860 tablet.cc:2369] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:41:55.201344 18313 raft_consensus.cc:482] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:41:55.201556 18313 raft_consensus.cc:504] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } }
I20260810 01:41:55.202801 18313 leader_election.cc:288] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a205acd98cb54f94841d40832b8fdad5 (127.16.58.65:42015), 2fdb85754f2c4d389004e86abad4d739 (127.16.58.67:42439)
I20260810 01:41:55.207660 18299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:55.203590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:52517 (local address 127.16.58.67:42439)
0810 01:41:55.203747 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:55.203751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:55.203909 (+ 158us) server_negotiation.cc:407] Connection header received
0810 01:41:55.204005 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:55.204007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:55.204053 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:55.204124 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:55.204352 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.205043 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.206461 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.207061 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.207181 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:55.207231 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:55.207459 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 01:41:55.207527 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 01:41:55.207659 18298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:55.203166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:51865 (local address 127.16.58.65:42015)
0810 01:41:55.203328 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:55.203333 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:55.203417 (+ 84us) server_negotiation.cc:407] Connection header received
0810 01:41:55.203630 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:55.203633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:55.203688 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:55.203766 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:55.204080 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.204849 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.206475 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.207061 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.207181 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:55.207231 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:55.207456 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 01:41:55.207527 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 01:41:55.207722 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:55.203048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42015 (local address 127.16.58.66:51865)
0810 01:41:55.203325 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:55.203337 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:55.203456 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:55.203795 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:55.203818 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:55.203844 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:55.203977 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:55.203984 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.204965 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.204968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:55.206353 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:55.206366 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.207172 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.207176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:55.207320 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:55.207357 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 01:41:55.207434 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:41:55.207528 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":116,"thread_start_us":98,"threads_started":1}
I20260810 01:41:55.207726 18316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:55.203466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:42439 (local address 127.16.58.66:52517)
0810 01:41:55.203794 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:55.203829 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:55.203926 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:55.204144 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:55.204146 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:55.204163 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:55.204259 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:55.204264 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.205136 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.205139 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:55.206353 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:55.206366 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.207172 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.207176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:55.207314 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:55.207366 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 01:41:55.207429 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 01:41:55.207528 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":80,"thread_start_us":100,"threads_started":1}
I20260810 01:41:55.208462 17788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5edd92cc4c494e06ba1c6c38d342b30a" candidate_uuid: "edbd61fcd8e4451d8544b84926445dab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a205acd98cb54f94841d40832b8fdad5" is_pre_election: true
I20260810 01:41:55.208534 18206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5edd92cc4c494e06ba1c6c38d342b30a" candidate_uuid: "edbd61fcd8e4451d8544b84926445dab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fdb85754f2c4d389004e86abad4d739" is_pre_election: true
I20260810 01:41:55.208904 17788 raft_consensus.cc:2454] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edbd61fcd8e4451d8544b84926445dab in term 0.
I20260810 01:41:55.209432 17888 leader_election.cc:302] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a205acd98cb54f94841d40832b8fdad5, edbd61fcd8e4451d8544b84926445dab; no voters:
I20260810 01:41:55.209697 18313 raft_consensus.cc:2781] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:41:55.209779 18313 raft_consensus.cc:482] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:41:55.209806 18313 raft_consensus.cc:3037] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:55.210759 18206 raft_consensus.cc:2454] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edbd61fcd8e4451d8544b84926445dab in term 0.
I20260810 01:41:55.210847 18313 raft_consensus.cc:504] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } }
I20260810 01:41:55.211167 18313 leader_election.cc:288] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [CANDIDATE]: Term 1 election: Requested vote from peers a205acd98cb54f94841d40832b8fdad5 (127.16.58.65:42015), 2fdb85754f2c4d389004e86abad4d739 (127.16.58.67:42439)
I20260810 01:41:55.211704 17788 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5edd92cc4c494e06ba1c6c38d342b30a" candidate_uuid: "edbd61fcd8e4451d8544b84926445dab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a205acd98cb54f94841d40832b8fdad5"
I20260810 01:41:55.211727 18206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5edd92cc4c494e06ba1c6c38d342b30a" candidate_uuid: "edbd61fcd8e4451d8544b84926445dab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fdb85754f2c4d389004e86abad4d739"
I20260810 01:41:55.211823 17788 raft_consensus.cc:3037] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:55.211870 18206 raft_consensus.cc:3037] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:55.212788 17788 raft_consensus.cc:2454] T 5edd92cc4c494e06ba1c6c38d342b30a P a205acd98cb54f94841d40832b8fdad5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edbd61fcd8e4451d8544b84926445dab in term 1.
I20260810 01:41:55.212898 18206 raft_consensus.cc:2454] T 5edd92cc4c494e06ba1c6c38d342b30a P 2fdb85754f2c4d389004e86abad4d739 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edbd61fcd8e4451d8544b84926445dab in term 1.
I20260810 01:41:55.213058 17888 leader_election.cc:302] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a205acd98cb54f94841d40832b8fdad5, edbd61fcd8e4451d8544b84926445dab; no voters:
I20260810 01:41:55.213218 18313 raft_consensus.cc:2781] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:55.213418 18313 raft_consensus.cc:686] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [term 1 LEADER]: Becoming Leader. State: Replica: edbd61fcd8e4451d8544b84926445dab, State: Running, Role: LEADER
I20260810 01:41:55.213714 18313 consensus_queue.cc:237] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } }
I20260810 01:41:55.216846 17556 catalog_manager.cc:5495] T 5edd92cc4c494e06ba1c6c38d342b30a P edbd61fcd8e4451d8544b84926445dab reported cstate change: term changed from 0 to 1, leader changed from <none> to edbd61fcd8e4451d8544b84926445dab (127.16.58.66). New cstate: current_term: 1 leader_uuid: "edbd61fcd8e4451d8544b84926445dab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a205acd98cb54f94841d40832b8fdad5" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edbd61fcd8e4451d8544b84926445dab" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fdb85754f2c4d389004e86abad4d739" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42439 } health_report { overall_health: UNKNOWN } } }
Aug 10 01:41:55 dist-test-slave-jlzn krb5kdc[17486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:41:55.238042 18298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:55.230416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33290 (local address 127.16.58.65:42015)
0810 01:41:55.230539 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:55.230543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:55.230702 (+ 159us) server_negotiation.cc:407] Connection header received
0810 01:41:55.230797 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:55.230799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:55.230838 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:55.230897 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:55.231453 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.231969 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.232731 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.232928 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.232991 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:55.235166 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:55.235176 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:55.235188 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:55.235210 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:55.236656 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:55.237012 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:55.237016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:55.237017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:55.237099 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:55.237283 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:55.237284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:55.237285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:55.237517 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:55.237687 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:55.237798 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 01:41:55.237887 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 01:41:55 dist-test-slave-jlzn krb5kdc[17486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326115, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:41:55 dist-test-slave-jlzn krb5kdc[17486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326115, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:41:55.263688 18298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:55.256209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33292 (local address 127.16.58.65:42015)
0810 01:41:55.256328 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:55.256332 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:55.256460 (+ 128us) server_negotiation.cc:407] Connection header received
0810 01:41:55.256584 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:55.256586 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:55.256630 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:55.256690 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:55.257294 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.257792 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.258600 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.258815 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.258919 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:55.261116 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:55.261119 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:55.261121 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:55.261144 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:55.262193 (+ 1049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:55.262570 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:55.262573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:55.262575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:55.262662 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:55.262901 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:55.262904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:55.262906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:55.263059 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:55.263172 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:55.263426 (+ 254us) server_negotiation.cc:299] Negotiation successful
0810 01:41:55.263535 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 01:41:55 dist-test-slave-jlzn krb5kdc[17486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:41:55 dist-test-slave-jlzn krb5kdc[17486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:41:55.286410 18298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:55.279608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33298 (local address 127.16.58.65:42015)
0810 01:41:55.279743 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:55.279748 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:55.279849 (+ 101us) server_negotiation.cc:407] Connection header received
0810 01:41:55.279957 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:55.279959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:55.279994 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:55.280055 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:55.280619 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.281106 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.281879 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:55.282072 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:55.282145 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:55.284168 (+ 2023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:55.284171 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:55.284172 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:55.284194 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:55.285255 (+ 1061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:55.285592 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:55.285595 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:55.285596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:55.285668 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:55.285842 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:55.285844 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:55.285845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:55.285976 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:55.286064 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:55.286215 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 01:41:55.286296 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 01:41:55.288105 17717 tablet_service.cc:2908] Rejecting scan request for tablet 5edd92cc4c494e06ba1c6c38d342b30a: Uninitialized: clean time has not yet been initialized
I20260810 01:41:55.290176 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17657
I20260810 01:41:55.304710 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17865
I20260810 01:41:55.318234 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18085
I20260810 01:41:55.328219 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17503
2026-08-10T01:41:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2726 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:55 dist-test-slave-jlzn krb5kdc[18339](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:55 dist-test-slave-jlzn krb5kdc[18339](info): set up 2 sockets
Aug 10 01:41:55 dist-test-slave-jlzn krb5kdc[18339](info): commencing operation
krb5kdc: starting...
W20260810 01:41:56.456694 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:41:56 dist-test-slave-jlzn krb5kdc[18339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:41:56.568920 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:36877
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:36877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:56.675731 18359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:56.676015 18359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:56.676071 18359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:56.679903 18359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:56.679951 18359 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 01:41:56.679975 18359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:56.679997 18359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:56.680027 18359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:56.680054 18359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:56.685062 18359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:36877
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:36877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:56.685969 18359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:56.686870 18359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:41:56.694854 18359 server_base.cc:1034] running on GCE node
W20260810 01:41:56.694873 18367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:56.694875 18366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:56.694834 18369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:56.695551 18359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:56.696556 18359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:56.697713 18359 hybrid_clock.cc:648] HybridClock initialized: now 1786326116697701 us; error 28 us; skew 500 ppm
Aug 10 01:41:56 dist-test-slave-jlzn krb5kdc[18339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326116, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:56.700260 18359 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:41:56.701064 18359 webserver.cc:460] Webserver started at http://127.16.58.126:46407/ using document root <none> and password file <none>
I20260810 01:41:56.701560 18359 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:56.701632 18359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:56.701830 18359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:56.703716 18359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "7ba62e0364dd4fc3a151a164679a16f2"
format_stamp: "Formatted at 2026-08-10 01:41:56 on dist-test-slave-jlzn"
server_key: "00d34a966572c805bcde8919878347c5"
server_key_iv: "e5164d060d4f8451534566baec3c15c0"
server_key_version: "encryptionkey@0"
I20260810 01:41:56.704304 18359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "7ba62e0364dd4fc3a151a164679a16f2"
format_stamp: "Formatted at 2026-08-10 01:41:56 on dist-test-slave-jlzn"
server_key: "00d34a966572c805bcde8919878347c5"
server_key_iv: "e5164d060d4f8451534566baec3c15c0"
server_key_version: "encryptionkey@0"
I20260810 01:41:56.707623 18359 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:41:56.709805 18379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:56.710870 18359 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:56.710983 18359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "7ba62e0364dd4fc3a151a164679a16f2"
format_stamp: "Formatted at 2026-08-10 01:41:56 on dist-test-slave-jlzn"
server_key: "00d34a966572c805bcde8919878347c5"
server_key_iv: "e5164d060d4f8451534566baec3c15c0"
server_key_version: "encryptionkey@0"
I20260810 01:41:56.711067 18359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:56.745077 18359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:56.747686 18359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:56.747874 18359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:56.755873 18359 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:36877
I20260810 01:41:56.755878 18489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:36877 every 8 connection(s)
I20260810 01:41:56.756736 18359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:56.759305 18490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:56.764274 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18359
I20260810 01:41:56.764389 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:41:56.764643 16617 external_mini_cluster.cc:1428] Setting key 2af960bc4f58e22f96f4a333ada96def
I20260810 01:41:56.764861 18490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2: Bootstrap starting.
I20260810 01:41:56.767261 18490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:56.768180 18490 log.cc:824] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:56.770143 18490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2: No bootstrap required, opened a new log
Aug 10 01:41:56 dist-test-slave-jlzn krb5kdc[18339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:56.774434 18490 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ba62e0364dd4fc3a151a164679a16f2" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36877 } }
I20260810 01:41:56.774658 18490 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:56.774751 18490 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ba62e0364dd4fc3a151a164679a16f2, State: Initialized, Role: FOLLOWER
I20260810 01:41:56.775241 18490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ba62e0364dd4fc3a151a164679a16f2" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36877 } }
I20260810 01:41:56.775424 18490 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:56.775493 18490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:56.775592 18490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:56.776599 18490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ba62e0364dd4fc3a151a164679a16f2" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36877 } }
I20260810 01:41:56.776955 18490 leader_election.cc:302] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ba62e0364dd4fc3a151a164679a16f2; no voters:
I20260810 01:41:56.777281 18490 leader_election.cc:288] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:56.777411 18498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:56.777644 18498 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [term 1 LEADER]: Becoming Leader. State: Replica: 7ba62e0364dd4fc3a151a164679a16f2, State: Running, Role: LEADER
I20260810 01:41:56.778009 18498 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ba62e0364dd4fc3a151a164679a16f2" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36877 } }
I20260810 01:41:56.778450 18490 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:56.779196 18498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ba62e0364dd4fc3a151a164679a16f2. Latest consensus state: current_term: 1 leader_uuid: "7ba62e0364dd4fc3a151a164679a16f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ba62e0364dd4fc3a151a164679a16f2" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36877 } } }
I20260810 01:41:56.779356 18498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:56.779265 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:56.765885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44650 (local address 127.16.58.126:36877)
0810 01:41:56.766300 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:56.766316 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:56.766352 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:41:56.766966 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:56.766983 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:56.767289 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:56.767573 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:56.768453 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:56.769427 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:56.770530 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:56.770988 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:56.771099 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:56.773796 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:56.773801 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:56.773813 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:56.773839 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:56.775720 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:56.776155 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:56.776162 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:56.776167 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:56.776317 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:56.776565 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:56.776569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:56.776570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:56.777071 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:56.777280 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:56.777947 (+ 667us) server_negotiation.cc:299] Negotiation successful
0810 01:41:56.778238 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":123,"threads_started":1}
I20260810 01:41:56.779618 18500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ba62e0364dd4fc3a151a164679a16f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ba62e0364dd4fc3a151a164679a16f2" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36877 } } }
I20260810 01:41:56.779716 18500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2 [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:56.780001 18515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:56.782976 18515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:56.788338 18515 catalog_manager.cc:1347] Generated new cluster ID: f70c43d8bbb14feb89234024bed8d670
I20260810 01:41:56.788390 18515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:56.815742 18515 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:56.816705 18515 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:56.825021 18515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2: Generated new TSK 0
I20260810 01:41:56.825619 18515 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:41:56.854694 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:36877
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:56.963867 18532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:56.964088 18532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:56.964131 18532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:56.968007 18532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:56.968056 18532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:56.968101 18532 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:41:56.968152 18532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:41:56.973126 18532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.58.126:36877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:56.974011 18532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:56.974912 18532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:56.983902 18543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:56.983901 18544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:56.983915 18549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:56.984047 18532 server_base.cc:1034] running on GCE node
I20260810 01:41:56.984493 18532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:56.985059 18532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:56.986218 18532 hybrid_clock.cc:648] HybridClock initialized: now 1786326116986197 us; error 30 us; skew 500 ppm
Aug 10 01:41:56 dist-test-slave-jlzn krb5kdc[18339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326116, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:56.988760 18532 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:41:56.989502 18532 webserver.cc:460] Webserver started at http://127.16.58.65:36339/ using document root <none> and password file <none>
I20260810 01:41:56.989992 18532 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:56.990057 18532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:56.990245 18532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:56.992143 18532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "e5d49cd5d09249409ec8889da28f9188"
format_stamp: "Formatted at 2026-08-10 01:41:56 on dist-test-slave-jlzn"
server_key: "a2eb3596e86e4f948a20d8e2c460605d"
server_key_iv: "f5ee1e29732631747754588ab54c3250"
server_key_version: "encryptionkey@0"
I20260810 01:41:56.992671 18532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "e5d49cd5d09249409ec8889da28f9188"
format_stamp: "Formatted at 2026-08-10 01:41:56 on dist-test-slave-jlzn"
server_key: "a2eb3596e86e4f948a20d8e2c460605d"
server_key_iv: "f5ee1e29732631747754588ab54c3250"
server_key_version: "encryptionkey@0"
I20260810 01:41:56.995996 18532 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:41:56.998114 18562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:56.999253 18532 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:56.999365 18532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "e5d49cd5d09249409ec8889da28f9188"
format_stamp: "Formatted at 2026-08-10 01:41:56 on dist-test-slave-jlzn"
server_key: "a2eb3596e86e4f948a20d8e2c460605d"
server_key_iv: "f5ee1e29732631747754588ab54c3250"
server_key_version: "encryptionkey@0"
I20260810 01:41:56.999469 18532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:57.011155 18532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:57.013645 18532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:57.013813 18532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:57.015112 18532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:57.015162 18532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:57.015202 18532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:57.015230 18532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:41:57 dist-test-slave-jlzn krb5kdc[18339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326116, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:57.025316 18532 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:36737
I20260810 01:41:57.025556 18755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:36737 every 8 connection(s)
I20260810 01:41:57.026172 18532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:41:57.028087 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.015798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:54985 (local address 127.16.58.126:36877)
0810 01:41:57.015958 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.015964 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.016791 (+ 827us) server_negotiation.cc:407] Connection header received
0810 01:41:57.017932 (+ 1141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.017936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.017997 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.018054 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:57.019750 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.020429 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.021743 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.021979 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.022068 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.024474 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:57.024478 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:57.024480 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:57.024505 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:57.025998 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.026559 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.026563 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.026565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.026651 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.027008 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.027011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.027013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.027200 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:57.027289 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.027755 (+ 466us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.027912 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:41:57.028736 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.016150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36877 (local address 127.16.58.65:54985)
0810 01:41:57.016622 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.016677 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.017678 (+ 1001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.018474 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.018484 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.018937 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:57.019564 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.019585 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.020566 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.020570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.021609 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.021619 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.022133 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.022138 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.022290 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.022757 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:57.022773 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:57.024315 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:57.026123 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.026129 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.026142 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.026433 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.026739 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.026742 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.026743 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.026916 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.027303 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:57.027310 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:57.027530 (+ 220us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.027689 (+ 159us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.028014 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":101,"threads_started":1}
I20260810 01:41:57.029726 18756 heartbeater.cc:347] Connected to a master server at 127.16.58.126:36877
I20260810 01:41:57.029935 18756 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:57.030238 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18532
I20260810 01:41:57.030349 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:41:57.030479 18756 heartbeater.cc:511] Master 127.16.58.126:36877 requested a full tablet report, sending...
I20260810 01:41:57.030653 16617 external_mini_cluster.cc:1428] Setting key 88c11fbcc24465bea00af2c8ee4a4a77
I20260810 01:41:57.032110 18410 ts_manager.cc:194] Registered new tserver with Master: e5d49cd5d09249409ec8889da28f9188 (127.16.58.65:36737)
I20260810 01:41:57.033234 18410 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:54985
I20260810 01:41:57.040700 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.032250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:34427 (local address 127.16.58.126:36877)
0810 01:41:57.032356 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.032360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.034380 (+ 2020us) server_negotiation.cc:407] Connection header received
0810 01:41:57.034459 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.034461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.034507 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.034589 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:57.035055 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.035586 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.036635 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.036845 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.036920 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.038014 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:57.038017 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:57.038019 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:57.038041 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:57.039235 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.039664 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.039666 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.039667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.039731 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.040008 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.040010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.040011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.040170 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:57.040241 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.040498 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.040593 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 01:41:57.040868 18769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.032123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36877 (local address 127.16.58.65:34427)
0810 01:41:57.034282 (+ 2159us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.034297 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.034389 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.034611 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.034614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.034812 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:57.034935 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.034941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.035724 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.035727 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.036531 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.036543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.036958 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.036963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.037062 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.037487 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:57.037502 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:57.037888 (+ 386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:57.039339 (+ 1451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.039342 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.039344 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.039580 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.039826 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.039829 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.039831 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.039926 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.040258 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:57.040261 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:57.040359 (+ 98us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.040466 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.040594 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2075,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:41:57.057785 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:36877
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:57.163789 18773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:57.164058 18773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:57.164114 18773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:57.167994 18773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:57.168042 18773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:57.168092 18773 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:41:57.168145 18773 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:41:57.173125 18773 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.58.126:36877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:57.174036 18773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:57.174965 18773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:57.183876 18781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:57.183912 18780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:57.183897 18784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:57.183936 18773 server_base.cc:1034] running on GCE node
I20260810 01:41:57.184490 18773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:57.185051 18773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:57.186196 18773 hybrid_clock.cc:648] HybridClock initialized: now 1786326117186171 us; error 36 us; skew 500 ppm
Aug 10 01:41:57 dist-test-slave-jlzn krb5kdc[18339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326117, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:57.188747 18773 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:41:57.189543 18773 webserver.cc:460] Webserver started at http://127.16.58.66:38965/ using document root <none> and password file <none>
I20260810 01:41:57.190052 18773 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:57.190117 18773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:57.190321 18773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:57.192303 18773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "16d20cb32f4042d5a8d145b4b5086ea4"
format_stamp: "Formatted at 2026-08-10 01:41:57 on dist-test-slave-jlzn"
server_key: "308caec05960d674c9ed46b8c35a170c"
server_key_iv: "3a0024df49e3f7417c2c91e3a9f092bf"
server_key_version: "encryptionkey@0"
I20260810 01:41:57.192818 18773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "16d20cb32f4042d5a8d145b4b5086ea4"
format_stamp: "Formatted at 2026-08-10 01:41:57 on dist-test-slave-jlzn"
server_key: "308caec05960d674c9ed46b8c35a170c"
server_key_iv: "3a0024df49e3f7417c2c91e3a9f092bf"
server_key_version: "encryptionkey@0"
I20260810 01:41:57.196183 18773 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:41:57.198349 18796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:57.199425 18773 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:57.199529 18773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "16d20cb32f4042d5a8d145b4b5086ea4"
format_stamp: "Formatted at 2026-08-10 01:41:57 on dist-test-slave-jlzn"
server_key: "308caec05960d674c9ed46b8c35a170c"
server_key_iv: "3a0024df49e3f7417c2c91e3a9f092bf"
server_key_version: "encryptionkey@0"
I20260810 01:41:57.199615 18773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:57.223966 18773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:57.226869 18773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:57.227033 18773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:57.228492 18773 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:57.228542 18773 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:57.228595 18773 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:57.228618 18773 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:41:57 dist-test-slave-jlzn krb5kdc[18339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326117, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:57.238332 18773 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:42793
I20260810 01:41:57.238417 18977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:42793 every 8 connection(s)
I20260810 01:41:57.239177 18773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:41:57.240964 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.229124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:50685 (local address 127.16.58.126:36877)
0810 01:41:57.229266 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.229271 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.230085 (+ 814us) server_negotiation.cc:407] Connection header received
0810 01:41:57.231282 (+ 1197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.231287 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.231352 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.231449 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:57.232741 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.233534 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.234706 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.234937 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.235026 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.237676 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:57.237680 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:57.237683 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:57.237711 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:57.239044 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.239531 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.239534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.239536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.239641 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.240045 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.240048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.240050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.240274 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:57.240355 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.240750 (+ 395us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.240843 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:41:57.241676 18806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.229508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36877 (local address 127.16.58.66:50685)
0810 01:41:57.229948 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.229995 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.230982 (+ 987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.231644 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.231653 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.232047 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:57.232587 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.232607 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.233664 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.233668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.234595 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.234608 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.235087 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.235092 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.235256 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.235724 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:57.235742 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:57.237516 (+ 1774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:57.239157 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.239162 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.239175 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.239439 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.239743 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.239746 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.239748 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.239948 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.240358 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:57.240363 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:57.240565 (+ 202us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.240704 (+ 139us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.240920 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":107,"threads_started":1}
I20260810 01:41:57.242730 18979 heartbeater.cc:347] Connected to a master server at 127.16.58.126:36877
I20260810 01:41:57.242883 18979 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:57.242904 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18773
I20260810 01:41:57.243008 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:41:57.243314 16617 external_mini_cluster.cc:1428] Setting key 1aa684ea734afc5ee3c76c92e9703d26
I20260810 01:41:57.243407 18979 heartbeater.cc:511] Master 127.16.58.126:36877 requested a full tablet report, sending...
I20260810 01:41:57.244419 18410 ts_manager.cc:194] Registered new tserver with Master: 16d20cb32f4042d5a8d145b4b5086ea4 (127.16.58.66:42793)
I20260810 01:41:57.244969 18410 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:50685
I20260810 01:41:57.252090 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.245421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:57991 (local address 127.16.58.126:36877)
0810 01:41:57.245516 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.245520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.245755 (+ 235us) server_negotiation.cc:407] Connection header received
0810 01:41:57.245855 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.245858 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.245897 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.245956 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:57.246349 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.246877 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.247942 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.248152 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.248231 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.249175 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:57.249179 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:57.249182 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:57.249205 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:57.250578 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.250969 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.250972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.250974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.251048 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.251285 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.251288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.251290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.251498 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:57.251584 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.251850 (+ 266us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.251946 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:41:57.252099 18987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.245399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36877 (local address 127.16.58.66:57991)
0810 01:41:57.245677 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.245689 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.245785 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.245981 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.245984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.246155 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:57.246248 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.246253 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.247022 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.247025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.247833 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.247845 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.248257 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.248261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.248351 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.248756 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:57.248767 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:57.249045 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:57.250682 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.250685 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.250686 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.250858 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.251130 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.251133 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.251134 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.251205 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.251590 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:57.251593 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:57.251680 (+ 87us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.251763 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.251913 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:41:57.270574 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:36877
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:57.377607 18990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:57.377841 18990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:57.377884 18990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:57.381844 18990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:57.381896 18990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:57.381935 18990 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:41:57.381985 18990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:41:57.387744 18990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.58.126:36877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:57.388680 18990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:57.389604 18990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:57.398404 19004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:57.398499 18998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:57.398532 18996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:57.398677 18990 server_base.cc:1034] running on GCE node
I20260810 01:41:57.399088 18990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:57.399680 18990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:57.400820 18990 hybrid_clock.cc:648] HybridClock initialized: now 1786326117400795 us; error 36 us; skew 500 ppm
Aug 10 01:41:57 dist-test-slave-jlzn krb5kdc[18339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326117, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:57.403403 18990 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:41:57.404260 18990 webserver.cc:460] Webserver started at http://127.16.58.67:37033/ using document root <none> and password file <none>
I20260810 01:41:57.404731 18990 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:57.404786 18990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:57.404943 18990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:57.406982 18990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "22076eab491e44ca8c232288b533a564"
format_stamp: "Formatted at 2026-08-10 01:41:57 on dist-test-slave-jlzn"
server_key: "d47b2effa5c874e453eed0e6adabca24"
server_key_iv: "6a010bab8d5361aa8e9ee77a0a4c819b"
server_key_version: "encryptionkey@0"
I20260810 01:41:57.407491 18990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "22076eab491e44ca8c232288b533a564"
format_stamp: "Formatted at 2026-08-10 01:41:57 on dist-test-slave-jlzn"
server_key: "d47b2effa5c874e453eed0e6adabca24"
server_key_iv: "6a010bab8d5361aa8e9ee77a0a4c819b"
server_key_version: "encryptionkey@0"
I20260810 01:41:57.410944 18990 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:41:57.413187 19016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:57.414306 18990 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:41:57.414412 18990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "22076eab491e44ca8c232288b533a564"
format_stamp: "Formatted at 2026-08-10 01:41:57 on dist-test-slave-jlzn"
server_key: "d47b2effa5c874e453eed0e6adabca24"
server_key_iv: "6a010bab8d5361aa8e9ee77a0a4c819b"
server_key_version: "encryptionkey@0"
I20260810 01:41:57.414498 18990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:57.431155 18990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:57.433972 18990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:57.434144 18990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:57.435496 18990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:57.435554 18990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:57.435606 18990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:57.435652 18990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:41:57 dist-test-slave-jlzn krb5kdc[18339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326117, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:57.445477 18990 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:43271
I20260810 01:41:57.445536 19202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:43271 every 8 connection(s)
I20260810 01:41:57.446455 18990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:41:57.448081 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.436168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:53007 (local address 127.16.58.126:36877)
0810 01:41:57.436313 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.436319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.437475 (+ 1156us) server_negotiation.cc:407] Connection header received
0810 01:41:57.438556 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.438560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.438623 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.438728 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:57.440048 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.440571 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.441723 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.441945 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.442031 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.444600 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:57.444604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:57.444607 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:57.444636 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:57.446146 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.446623 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.446627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.446629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.446708 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.447087 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.447090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.447092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.447310 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:57.447410 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.447855 (+ 445us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.447958 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:41:57.448874 19037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.436900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36877 (local address 127.16.58.67:53007)
0810 01:41:57.437325 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.437374 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.438314 (+ 940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.438878 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.438885 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.439257 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:57.439908 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.439925 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.440694 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.440698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.441603 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.441614 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.442098 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.442102 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.442259 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.442738 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:57.442758 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:57.444445 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:57.446252 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.446257 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.446268 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.446495 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.446792 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.446795 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.446798 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.446975 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.447413 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:57.447418 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:57.447635 (+ 217us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.447788 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.448080 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":96,"threads_started":1}
I20260810 01:41:57.449928 19203 heartbeater.cc:347] Connected to a master server at 127.16.58.126:36877
I20260810 01:41:57.450074 19203 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:57.450515 19203 heartbeater.cc:511] Master 127.16.58.126:36877 requested a full tablet report, sending...
I20260810 01:41:57.451429 18411 ts_manager.cc:194] Registered new tserver with Master: 22076eab491e44ca8c232288b533a564 (127.16.58.67:43271)
I20260810 01:41:57.452131 18411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:53007
I20260810 01:41:57.456070 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18990
I20260810 01:41:57.456185 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:41:57.456434 16617 external_mini_cluster.cc:1428] Setting key fe5104d58fe25ece79c4facc8781e00e
I20260810 01:41:57.458141 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.451968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:51291 (local address 127.16.58.126:36877)
0810 01:41:57.452084 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.452087 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.452267 (+ 180us) server_negotiation.cc:407] Connection header received
0810 01:41:57.452348 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.452350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.452386 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.452447 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:57.452852 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.453339 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.454095 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.454315 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.454398 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.455320 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:57.455323 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:57.455326 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:57.455350 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:57.456560 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.456978 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.456981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.456983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.457058 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.457366 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.457368 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.457369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.457571 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:57.457665 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.457901 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.457996 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:41:57.458161 19211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.451905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36877 (local address 127.16.58.67:51291)
0810 01:41:57.452163 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.452177 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.452272 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.452494 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.452497 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.452665 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:57.452751 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.452756 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.453451 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.453454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.453991 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.453999 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.454411 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.454415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.454502 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.454892 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:57.454906 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:57.455198 (+ 292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:57.456648 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.456652 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.456654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.456882 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.457168 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.457171 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.457172 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.457274 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.457663 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:57.457666 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:57.457753 (+ 87us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.457838 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.457965 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":95,"threads_started":1}
I20260810 01:41:57.458300 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 01:41:57 dist-test-slave-jlzn krb5kdc[18339](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326117, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:41:57 dist-test-slave-jlzn krb5kdc[18339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326117, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:57.482240 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.475375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44658 (local address 127.16.58.126:36877)
0810 01:41:57.475474 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.475477 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.475487 (+ 10us) server_negotiation.cc:407] Connection header received
0810 01:41:57.475520 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.475522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.475555 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.475616 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:57.476275 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.476757 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.477487 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.477680 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.477740 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.479836 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:57.479841 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:57.479844 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:57.479871 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:57.481029 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.481384 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.481386 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.481387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.481451 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.481627 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.481629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.481630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.481773 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:57.481865 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.482010 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.482089 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:41:57.484683 18411 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44658:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:41:57.487488 18411 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:41:57.500468 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.495200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41978 (local address 127.16.58.66:42793)
0810 01:41:57.495511 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.495526 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.496019 (+ 493us) server_negotiation.cc:407] Connection header received
0810 01:41:57.496099 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.496104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.496305 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.496448 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:57.496902 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.497873 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.499027 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.499850 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.499949 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.500106 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.500239 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.500331 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":105,"threads_started":1}
I20260810 01:41:57.500464 19231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.495054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42793 (local address 127.0.0.1:41978)
0810 01:41:57.495659 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.495707 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.495873 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.496619 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.496640 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.496665 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:57.496781 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.496789 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.497962 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.497965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.498869 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.498879 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.499957 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.499960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.500066 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.500107 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.500210 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.500323 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"spinlock_wait_cycles":3456,"thread_start_us":72,"threads_started":1}
I20260810 01:41:57.501418 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.495166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:43271 (local address 127.0.0.1:60170)
0810 01:41:57.495679 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.495707 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.495992 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.497121 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.497125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.497154 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:57.497245 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.497251 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.498738 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.498742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.500056 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.500067 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.501030 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.501034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.501120 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.501151 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.501228 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.501292 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":161,"spinlock_wait_cycles":1920,"thread_start_us":106,"threads_started":1}
I20260810 01:41:57.501466 19238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.496196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60170 (local address 127.16.58.67:43271)
0810 01:41:57.496686 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.496697 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.496717 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:41:57.496796 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.496801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.496975 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.497110 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:57.497350 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.498620 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.500187 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.500919 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.501018 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.501164 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.501256 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.501339 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":116,"threads_started":1}
I20260810 01:41:57.501871 19234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.495753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:36737 (local address 127.0.0.1:57986)
0810 01:41:57.496997 (+ 1244us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.497009 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.497092 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.497567 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.497569 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.497586 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:57.497656 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.497660 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.498886 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.498890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.499926 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.499938 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.501503 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.501506 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.501590 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.501612 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.501680 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.501752 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1185,"mutex_wait_us":8,"thread_start_us":118,"threads_started":1}
I20260810 01:41:57.502310 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.496173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57986 (local address 127.16.58.65:36737)
0810 01:41:57.496453 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.496464 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.497189 (+ 725us) server_negotiation.cc:407] Connection header received
0810 01:41:57.497272 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.497276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.497441 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.497585 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:57.497731 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.498791 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.500058 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.501196 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.501294 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.501438 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.502070 (+ 632us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.502175 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":90,"threads_started":1}
I20260810 01:41:57.503634 18864 tablet_service.cc:1467] Processing CreateTablet for tablet 4d55f1984cab48ac96252c3849ac9211 (DEFAULT_TABLE table=test-table [id=ce2985a9ab5d4f0baa69c7a846743f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:57.504148 19108 tablet_service.cc:1467] Processing CreateTablet for tablet 4d55f1984cab48ac96252c3849ac9211 (DEFAULT_TABLE table=test-table [id=ce2985a9ab5d4f0baa69c7a846743f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:57.504801 18864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d55f1984cab48ac96252c3849ac9211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:57.505014 19108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d55f1984cab48ac96252c3849ac9211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:57.504927 18654 tablet_service.cc:1467] Processing CreateTablet for tablet 4d55f1984cab48ac96252c3849ac9211 (DEFAULT_TABLE table=test-table [id=ce2985a9ab5d4f0baa69c7a846743f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:57.505939 18654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d55f1984cab48ac96252c3849ac9211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:57.511015 19239 tablet_bootstrap.cc:492] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: Bootstrap starting.
I20260810 01:41:57.513278 19241 tablet_bootstrap.cc:492] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: Bootstrap starting.
I20260810 01:41:57.513492 19239 tablet_bootstrap.cc:654] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:57.513832 19240 tablet_bootstrap.cc:492] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: Bootstrap starting.
I20260810 01:41:57.514371 19239 log.cc:824] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:57.515342 19241 tablet_bootstrap.cc:654] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:57.515861 19240 tablet_bootstrap.cc:654] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:57.516203 19241 log.cc:824] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:57.516278 19239 tablet_bootstrap.cc:492] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: No bootstrap required, opened a new log
I20260810 01:41:57.516528 19239 ts_tablet_manager.cc:1397] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:41:57.516719 19240 log.cc:824] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:57.518409 19240 tablet_bootstrap.cc:492] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: No bootstrap required, opened a new log
I20260810 01:41:57.518581 19240 ts_tablet_manager.cc:1397] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260810 01:41:57.519496 19241 tablet_bootstrap.cc:492] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: No bootstrap required, opened a new log
I20260810 01:41:57.519686 19241 ts_tablet_manager.cc:1397] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260810 01:41:57.519851 19239 raft_consensus.cc:348] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } }
I20260810 01:41:57.520120 19239 raft_consensus.cc:374] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:57.520226 19239 raft_consensus.cc:729] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22076eab491e44ca8c232288b533a564, State: Initialized, Role: FOLLOWER
I20260810 01:41:57.520684 19239 consensus_queue.cc:260] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } }
I20260810 01:41:57.521363 19203 heartbeater.cc:503] Master 127.16.58.126:36877 was elected leader, sending a full tablet report...
I20260810 01:41:57.521672 19239 ts_tablet_manager.cc:1428] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:41:57.521823 19240 raft_consensus.cc:348] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } }
I20260810 01:41:57.522131 19240 raft_consensus.cc:374] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:57.522244 19240 raft_consensus.cc:729] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16d20cb32f4042d5a8d145b4b5086ea4, State: Initialized, Role: FOLLOWER
I20260810 01:41:57.522768 19240 consensus_queue.cc:260] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } }
I20260810 01:41:57.523367 18979 heartbeater.cc:503] Master 127.16.58.126:36877 was elected leader, sending a full tablet report...
I20260810 01:41:57.523314 19241 raft_consensus.cc:348] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } }
I20260810 01:41:57.523535 19241 raft_consensus.cc:374] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:57.523582 19241 raft_consensus.cc:729] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d49cd5d09249409ec8889da28f9188, State: Initialized, Role: FOLLOWER
I20260810 01:41:57.523674 19240 ts_tablet_manager.cc:1428] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260810 01:41:57.523983 19241 consensus_queue.cc:260] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } }
I20260810 01:41:57.524880 19241 ts_tablet_manager.cc:1428] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:41:57.525018 18756 heartbeater.cc:503] Master 127.16.58.126:36877 was elected leader, sending a full tablet report...
W20260810 01:41:57.527653 18757 tablet.cc:2369] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:41:57.590920 19246 raft_consensus.cc:482] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:41:57.591089 19246 raft_consensus.cc:504] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } }
I20260810 01:41:57.592160 19246 leader_election.cc:288] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16d20cb32f4042d5a8d145b4b5086ea4 (127.16.58.66:42793), e5d49cd5d09249409ec8889da28f9188 (127.16.58.65:36737)
I20260810 01:41:57.596235 19037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.592363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42793 (local address 127.16.58.67:60147)
0810 01:41:57.592533 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.592548 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.592644 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.592877 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.592880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.592895 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:57.592999 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.593005 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.593985 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.593988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.595253 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.595265 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.595913 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.595916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.595999 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.596021 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.596076 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.596132 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260810 01:41:57.596290 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.592489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:60147 (local address 127.16.58.66:42793)
0810 01:41:57.592616 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.592620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.592647 (+ 27us) server_negotiation.cc:407] Connection header received
0810 01:41:57.592742 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.592744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.592784 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.592860 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:57.593105 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.593890 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.595381 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.595782 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.595928 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.595982 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.596102 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.596170 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:41:57.596872 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.592500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:33715 (local address 127.16.58.65:36737)
0810 01:41:57.592604 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.592607 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.592843 (+ 236us) server_negotiation.cc:407] Connection header received
0810 01:41:57.592920 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.592923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.592969 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.593024 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:57.593271 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.593976 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.595831 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.596384 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.596496 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.596544 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.596727 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.596783 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:41:57.596879 19250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.592430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:36737 (local address 127.16.58.67:33715)
0810 01:41:57.592753 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.592763 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.592841 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.593045 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.593048 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.593064 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:57.593172 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.593177 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.594056 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.594059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.595695 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.595703 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.596490 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.596493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.596591 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.596614 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.596696 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.596758 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":108,"threads_started":1}
I20260810 01:41:57.596855 18900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d55f1984cab48ac96252c3849ac9211" candidate_uuid: "22076eab491e44ca8c232288b533a564" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" is_pre_election: true
I20260810 01:41:57.597168 18900 raft_consensus.cc:2454] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22076eab491e44ca8c232288b533a564 in term 0.
I20260810 01:41:57.597442 18684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d55f1984cab48ac96252c3849ac9211" candidate_uuid: "22076eab491e44ca8c232288b533a564" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d49cd5d09249409ec8889da28f9188" is_pre_election: true
I20260810 01:41:57.597631 19020 leader_election.cc:302] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16d20cb32f4042d5a8d145b4b5086ea4, 22076eab491e44ca8c232288b533a564; no voters:
I20260810 01:41:57.597704 18684 raft_consensus.cc:2454] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 22076eab491e44ca8c232288b533a564 in term 0.
I20260810 01:41:57.597880 19246 raft_consensus.cc:2781] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:41:57.597976 19246 raft_consensus.cc:482] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:41:57.598016 19246 raft_consensus.cc:3037] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:57.599047 19246 raft_consensus.cc:504] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } }
I20260810 01:41:57.599344 19246 leader_election.cc:288] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [CANDIDATE]: Term 1 election: Requested vote from peers 16d20cb32f4042d5a8d145b4b5086ea4 (127.16.58.66:42793), e5d49cd5d09249409ec8889da28f9188 (127.16.58.65:36737)
I20260810 01:41:57.599687 18684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d55f1984cab48ac96252c3849ac9211" candidate_uuid: "22076eab491e44ca8c232288b533a564" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d49cd5d09249409ec8889da28f9188"
I20260810 01:41:57.599687 18900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d55f1984cab48ac96252c3849ac9211" candidate_uuid: "22076eab491e44ca8c232288b533a564" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16d20cb32f4042d5a8d145b4b5086ea4"
I20260810 01:41:57.599823 18684 raft_consensus.cc:3037] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:57.599823 18900 raft_consensus.cc:3037] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:57.601089 18684 raft_consensus.cc:2454] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22076eab491e44ca8c232288b533a564 in term 1.
I20260810 01:41:57.601389 19019 leader_election.cc:302] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22076eab491e44ca8c232288b533a564, e5d49cd5d09249409ec8889da28f9188; no voters:
I20260810 01:41:57.601560 19246 raft_consensus.cc:2781] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:57.601588 18900 raft_consensus.cc:2454] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 22076eab491e44ca8c232288b533a564 in term 1.
I20260810 01:41:57.601760 19246 raft_consensus.cc:686] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 1 LEADER]: Becoming Leader. State: Replica: 22076eab491e44ca8c232288b533a564, State: Running, Role: LEADER
I20260810 01:41:57.602095 19246 consensus_queue.cc:237] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } }
I20260810 01:41:57.605171 18408 catalog_manager.cc:5495] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 reported cstate change: term changed from 0 to 1, leader changed from <none> to 22076eab491e44ca8c232288b533a564 (127.16.58.67). New cstate: current_term: 1 leader_uuid: "22076eab491e44ca8c232288b533a564" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } health_report { overall_health: UNKNOWN } } }
I20260810 01:41:57.637904 19238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.634367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60176 (local address 127.16.58.67:43271)
0810 01:41:57.634483 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.634488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.634500 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:41:57.634699 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.634701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.634755 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.634833 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:57.635095 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.635581 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.636501 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.636724 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.636812 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.637129 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:57.637529 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:57.637628 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.637724 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.637776 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:41:57.643602 18900 raft_consensus.cc:1261] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 FOLLOWER]: Refusing update from remote peer 22076eab491e44ca8c232288b533a564: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:57.644389 19251 consensus_queue.cc:1035] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:57.644546 18684 raft_consensus.cc:1261] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Refusing update from remote peer 22076eab491e44ca8c232288b533a564: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:57.645048 19251 consensus_queue.cc:1035] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:57.650980 19255 mvcc.cc:205] Tried to move back new op lower bound from 7316791777860374528 to 7316791777700593664. Current Snapshot: MvccSnapshot[applied={T|T < 7316791777860374528}]
I20260810 01:41:57.653461 19257 mvcc.cc:205] Tried to move back new op lower bound from 7316791777860374528 to 7316791777700593664. Current Snapshot: MvccSnapshot[applied={T|T < 7316791777860374528}]
I20260810 01:41:57.663125 18411 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:57.663379 18411 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:57.665904 18411 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2: Sending DeleteTablet for 3 replicas of tablet 4d55f1984cab48ac96252c3849ac9211
I20260810 01:41:57.666702 18864 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d55f1984cab48ac96252c3849ac9211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:57 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:41978
I20260810 01:41:57.666774 18654 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d55f1984cab48ac96252c3849ac9211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:57 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:57986
I20260810 01:41:57.666818 19108 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d55f1984cab48ac96252c3849ac9211 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:57 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:60170
I20260810 01:41:57.667265 19278 tablet_replica.cc:330] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: stopping tablet replica
I20260810 01:41:57.667325 19273 tablet_replica.cc:330] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: stopping tablet replica
I20260810 01:41:57.667608 19278 raft_consensus.cc:2229] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:41:57.667614 19273 raft_consensus.cc:2229] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:41:57.667650 18411 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44658:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 01:41:57.667927 19273 raft_consensus.cc:2258] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:57.668030 19278 raft_consensus.cc:2258] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 01:41:57.668169 18411 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:41:57.668481 19277 tablet_replica.cc:330] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: stopping tablet replica
I20260810 01:41:57.668733 19277 raft_consensus.cc:2229] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:41:57.669643 19277 raft_consensus.cc:2258] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:57.669787 19278 ts_tablet_manager.cc:1905] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:57.671097 19277 ts_tablet_manager.cc:1905] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:57.672610 19278 ts_tablet_manager.cc:1918] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:57.672757 19278 log.cc:1196] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/4d55f1984cab48ac96252c3849ac9211
I20260810 01:41:57.673079 19278 ts_tablet_manager.cc:1939] T 4d55f1984cab48ac96252c3849ac9211 P e5d49cd5d09249409ec8889da28f9188: Deleting consensus metadata
I20260810 01:41:57.673435 19108 tablet_service.cc:1467] Processing CreateTablet for tablet 183e638ab1914a9fb325cfe323a54316 (DEFAULT_TABLE table=test-table [id=f0aa16a4650a494395a80ef06dba63d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:57.673563 18654 tablet_service.cc:1467] Processing CreateTablet for tablet 183e638ab1914a9fb325cfe323a54316 (DEFAULT_TABLE table=test-table [id=f0aa16a4650a494395a80ef06dba63d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:57.673691 19108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183e638ab1914a9fb325cfe323a54316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:57.673774 18654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183e638ab1914a9fb325cfe323a54316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:57.675872 19273 ts_tablet_manager.cc:1905] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:57.676007 18864 tablet_service.cc:1467] Processing CreateTablet for tablet 183e638ab1914a9fb325cfe323a54316 (DEFAULT_TABLE table=test-table [id=f0aa16a4650a494395a80ef06dba63d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:41:57.676276 18864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183e638ab1914a9fb325cfe323a54316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:57.676707 19277 ts_tablet_manager.cc:1918] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:57.676782 19277 log.cc:1196] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/4d55f1984cab48ac96252c3849ac9211
I20260810 01:41:57.677047 19277 ts_tablet_manager.cc:1939] T 4d55f1984cab48ac96252c3849ac9211 P 22076eab491e44ca8c232288b533a564: Deleting consensus metadata
I20260810 01:41:57.678104 19241 tablet_bootstrap.cc:492] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: Bootstrap starting.
I20260810 01:41:57.678668 19240 tablet_bootstrap.cc:492] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: Bootstrap starting.
I20260810 01:41:57.679059 19241 tablet_bootstrap.cc:654] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:57.679617 19240 tablet_bootstrap.cc:654] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:57.679832 19273 ts_tablet_manager.cc:1918] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:41:57.679915 19273 log.cc:1196] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/4d55f1984cab48ac96252c3849ac9211
I20260810 01:41:57.680166 19239 tablet_bootstrap.cc:492] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: Bootstrap starting.
I20260810 01:41:57.680186 19273 ts_tablet_manager.cc:1939] T 4d55f1984cab48ac96252c3849ac9211 P 16d20cb32f4042d5a8d145b4b5086ea4: Deleting consensus metadata
I20260810 01:41:57.681100 19239 tablet_bootstrap.cc:654] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:57.681102 19241 tablet_bootstrap.cc:492] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: No bootstrap required, opened a new log
I20260810 01:41:57.681191 19241 ts_tablet_manager.cc:1397] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:41:57.681643 19241 raft_consensus.cc:348] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.681756 19241 raft_consensus.cc:374] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:57.681747 18380 catalog_manager.cc:4841] TS 22076eab491e44ca8c232288b533a564 (127.16.58.67:43271): tablet 4d55f1984cab48ac96252c3849ac9211 (table test-table [id=ce2985a9ab5d4f0baa69c7a846743f4f]) successfully deleted
I20260810 01:41:57.681789 19241 raft_consensus.cc:729] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d49cd5d09249409ec8889da28f9188, State: Initialized, Role: FOLLOWER
I20260810 01:41:57.681886 18380 catalog_manager.cc:4841] TS e5d49cd5d09249409ec8889da28f9188 (127.16.58.65:36737): tablet 4d55f1984cab48ac96252c3849ac9211 (table test-table [id=ce2985a9ab5d4f0baa69c7a846743f4f]) successfully deleted
I20260810 01:41:57.682050 18382 catalog_manager.cc:4841] TS 16d20cb32f4042d5a8d145b4b5086ea4 (127.16.58.66:42793): tablet 4d55f1984cab48ac96252c3849ac9211 (table test-table [id=ce2985a9ab5d4f0baa69c7a846743f4f]) successfully deleted
I20260810 01:41:57.682276 19239 tablet_bootstrap.cc:492] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: No bootstrap required, opened a new log
I20260810 01:41:57.682349 19239 ts_tablet_manager.cc:1397] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:57.682348 19241 consensus_queue.cc:260] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.682785 19239 raft_consensus.cc:348] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.682883 19239 raft_consensus.cc:374] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:57.682914 19239 raft_consensus.cc:729] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22076eab491e44ca8c232288b533a564, State: Initialized, Role: FOLLOWER
I20260810 01:41:57.683023 19239 consensus_queue.cc:260] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.683275 19239 ts_tablet_manager.cc:1428] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:41:57.683774 19240 tablet_bootstrap.cc:492] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: No bootstrap required, opened a new log
I20260810 01:41:57.683873 19240 ts_tablet_manager.cc:1397] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260810 01:41:57.684223 19241 ts_tablet_manager.cc:1428] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260810 01:41:57.684273 19240 raft_consensus.cc:348] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.684373 19240 raft_consensus.cc:374] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:57.684401 19240 raft_consensus.cc:729] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16d20cb32f4042d5a8d145b4b5086ea4, State: Initialized, Role: FOLLOWER
I20260810 01:41:57.684509 19240 consensus_queue.cc:260] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.684736 19240 ts_tablet_manager.cc:1428] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260810 01:41:57.697275 19205 tablet.cc:2369] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:41:57.740257 18980 tablet.cc:2369] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:41:57.861395 19248 raft_consensus.cc:482] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:41:57.861558 19248 raft_consensus.cc:504] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.862768 19248 leader_election.cc:288] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d49cd5d09249409ec8889da28f9188 (127.16.58.65:36737), 22076eab491e44ca8c232288b533a564 (127.16.58.67:43271)
I20260810 01:41:57.866703 19238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.863477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:59247 (local address 127.16.58.67:43271)
0810 01:41:57.863633 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.863637 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.863654 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:41:57.863826 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.863829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.863877 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.863950 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:57.864216 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.864694 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.865744 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.866148 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.866255 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.866308 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.866514 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.866582 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:41:57.866710 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.863063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:58621 (local address 127.16.58.65:36737)
0810 01:41:57.863184 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.863188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.863296 (+ 108us) server_negotiation.cc:407] Connection header received
0810 01:41:57.863598 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.863603 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.863670 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.863739 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:41:57.864066 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.864619 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.865757 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.866146 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.866251 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.866308 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.866498 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.866575 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:41:57.866726 19284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.863357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:43271 (local address 127.16.58.66:59247)
0810 01:41:57.863596 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.863609 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.863696 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.863974 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.863976 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.863992 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:57.864100 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.864106 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.864802 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.864804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.865625 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.865634 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.866263 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.866266 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.866400 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.866419 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.866487 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.866575 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":71,"thread_start_us":83,"threads_started":1}
I20260810 01:41:57.866726 19283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.862976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:36737 (local address 127.16.58.66:58621)
0810 01:41:57.863218 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.863233 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.863342 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.863776 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.863779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.863824 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:41:57.863955 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.863962 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.864737 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.864741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.865630 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.865640 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.866258 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.866262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.866359 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.866405 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.866461 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.866540 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":42,"thread_start_us":78,"threads_started":1}
I20260810 01:41:57.867401 18684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183e638ab1914a9fb325cfe323a54316" candidate_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d49cd5d09249409ec8889da28f9188" is_pre_election: true
I20260810 01:41:57.867535 18684 raft_consensus.cc:2454] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16d20cb32f4042d5a8d145b4b5086ea4 in term 0.
I20260810 01:41:57.867486 19140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183e638ab1914a9fb325cfe323a54316" candidate_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22076eab491e44ca8c232288b533a564" is_pre_election: true
I20260810 01:41:57.867702 19140 raft_consensus.cc:2454] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16d20cb32f4042d5a8d145b4b5086ea4 in term 0.
I20260810 01:41:57.867878 18797 leader_election.cc:302] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16d20cb32f4042d5a8d145b4b5086ea4, e5d49cd5d09249409ec8889da28f9188; no voters:
I20260810 01:41:57.868122 19248 raft_consensus.cc:2781] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:41:57.868182 19248 raft_consensus.cc:482] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:41:57.868208 19248 raft_consensus.cc:3037] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:57.869128 19248 raft_consensus.cc:504] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.869433 19248 leader_election.cc:288] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [CANDIDATE]: Term 1 election: Requested vote from peers e5d49cd5d09249409ec8889da28f9188 (127.16.58.65:36737), 22076eab491e44ca8c232288b533a564 (127.16.58.67:43271)
I20260810 01:41:57.869794 19140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183e638ab1914a9fb325cfe323a54316" candidate_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22076eab491e44ca8c232288b533a564"
I20260810 01:41:57.869843 18684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183e638ab1914a9fb325cfe323a54316" candidate_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d49cd5d09249409ec8889da28f9188"
I20260810 01:41:57.869891 19140 raft_consensus.cc:3037] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:57.869954 18684 raft_consensus.cc:3037] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:57.870770 19140 raft_consensus.cc:2454] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16d20cb32f4042d5a8d145b4b5086ea4 in term 1.
I20260810 01:41:57.870805 18684 raft_consensus.cc:2454] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16d20cb32f4042d5a8d145b4b5086ea4 in term 1.
I20260810 01:41:57.871048 18797 leader_election.cc:302] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16d20cb32f4042d5a8d145b4b5086ea4, e5d49cd5d09249409ec8889da28f9188; no voters:
I20260810 01:41:57.871201 19248 raft_consensus.cc:2781] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:57.871351 19248 raft_consensus.cc:686] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 LEADER]: Becoming Leader. State: Replica: 16d20cb32f4042d5a8d145b4b5086ea4, State: Running, Role: LEADER
I20260810 01:41:57.871579 19248 consensus_queue.cc:237] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.873596 18411 catalog_manager.cc:5495] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16d20cb32f4042d5a8d145b4b5086ea4 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } health_report { overall_health: UNKNOWN } } }
Aug 10 01:41:57 dist-test-slave-jlzn krb5kdc[18339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326116, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:57.932492 19292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.925198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36877 (local address 127.0.0.1:44672)
0810 01:41:57.925455 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:57.925468 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:57.925556 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:57.925744 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:57.925746 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:57.926111 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:57.926206 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.926212 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.926847 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.926849 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.927385 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:57.927391 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.927716 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.927718 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:57.927771 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.928273 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:57.928284 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:57.929693 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:57.931218 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.931227 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.931232 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.931452 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.931668 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:57.931670 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:57.931671 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:57.931743 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:57.932034 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:57.932039 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:57.932141 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 01:41:57.932229 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 01:41:57.932341 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":86,"threads_started":1}
I20260810 01:41:57.932521 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:57.925271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44672 (local address 127.16.58.126:36877)
0810 01:41:57.925384 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:57.925389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:57.925528 (+ 139us) server_negotiation.cc:407] Connection header received
0810 01:41:57.925619 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:57.925621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:57.925658 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:57.925720 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:57.926288 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.926773 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.927459 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:57.927648 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:57.927708 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:57.929814 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:57.929817 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:57.929819 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:57.929840 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:57.931126 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.931538 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.931541 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.931542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.931606 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:57.931813 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:57.931815 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:57.931816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:57.931960 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:57.932028 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:57.932267 (+ 239us) server_negotiation.cc:299] Negotiation successful
0810 01:41:57.932395 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":40}
I20260810 01:41:57.936071 18411 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:44672:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 01:41:57.936762 18411 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:41:57.941236 18654 tablet_service.cc:1467] Processing CreateTablet for tablet d514f38120024405b50d896c081c4ccb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e37c2f62ce2c4211b64c468f54ab7982]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:41:57.941345 18864 tablet_service.cc:1467] Processing CreateTablet for tablet d514f38120024405b50d896c081c4ccb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e37c2f62ce2c4211b64c468f54ab7982]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:41:57.941380 19108 tablet_service.cc:1467] Processing CreateTablet for tablet d514f38120024405b50d896c081c4ccb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e37c2f62ce2c4211b64c468f54ab7982]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:41:57.941706 18654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d514f38120024405b50d896c081c4ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:57.941716 19108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d514f38120024405b50d896c081c4ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:57.941717 18864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d514f38120024405b50d896c081c4ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:41:57.944365 19241 tablet_bootstrap.cc:492] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: Bootstrap starting.
I20260810 01:41:57.944434 19239 tablet_bootstrap.cc:492] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: Bootstrap starting.
I20260810 01:41:57.944459 19240 tablet_bootstrap.cc:492] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: Bootstrap starting.
I20260810 01:41:57.945288 19241 tablet_bootstrap.cc:654] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:57.945310 19239 tablet_bootstrap.cc:654] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:57.945340 19240 tablet_bootstrap.cc:654] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:57.946604 19239 tablet_bootstrap.cc:492] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: No bootstrap required, opened a new log
I20260810 01:41:57.946604 19241 tablet_bootstrap.cc:492] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: No bootstrap required, opened a new log
I20260810 01:41:57.946688 19240 tablet_bootstrap.cc:492] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: No bootstrap required, opened a new log
I20260810 01:41:57.946691 19241 ts_tablet_manager.cc:1397] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:41:57.946691 19239 ts_tablet_manager.cc:1397] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:41:57.946770 19240 ts_tablet_manager.cc:1397] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:41:57.947101 19240 raft_consensus.cc:348] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.947086 19241 raft_consensus.cc:348] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.947086 19239 raft_consensus.cc:348] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.947189 19240 raft_consensus.cc:374] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:57.947193 19241 raft_consensus.cc:374] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:57.947193 19239 raft_consensus.cc:374] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:57.947209 19240 raft_consensus.cc:729] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16d20cb32f4042d5a8d145b4b5086ea4, State: Initialized, Role: FOLLOWER
I20260810 01:41:57.947227 19239 raft_consensus.cc:729] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22076eab491e44ca8c232288b533a564, State: Initialized, Role: FOLLOWER
I20260810 01:41:57.947227 19241 raft_consensus.cc:729] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d49cd5d09249409ec8889da28f9188, State: Initialized, Role: FOLLOWER
I20260810 01:41:57.947309 19240 consensus_queue.cc:260] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.947343 19239 consensus_queue.cc:260] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.947343 19241 consensus_queue.cc:260] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:57.947556 19240 ts_tablet_manager.cc:1428] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:41:57.947608 19239 ts_tablet_manager.cc:1428] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:41:57.947603 19241 ts_tablet_manager.cc:1428] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:41:57.947888 19248 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:57.948001 19248 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:41:57.948282 19266 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:57.948405 19266 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:41:57.949750 19249 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:57.949903 19249 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:41:58.036966 19248 raft_consensus.cc:482] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:41:58.037091 19248 raft_consensus.cc:504] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:58.037456 19248 leader_election.cc:288] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d49cd5d09249409ec8889da28f9188 (127.16.58.65:36737), 22076eab491e44ca8c232288b533a564 (127.16.58.67:43271)
I20260810 01:41:58.037868 19140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d514f38120024405b50d896c081c4ccb" candidate_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22076eab491e44ca8c232288b533a564" is_pre_election: true
I20260810 01:41:58.037864 18684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d514f38120024405b50d896c081c4ccb" candidate_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d49cd5d09249409ec8889da28f9188" is_pre_election: true
I20260810 01:41:58.037998 18684 raft_consensus.cc:2454] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16d20cb32f4042d5a8d145b4b5086ea4 in term 0.
I20260810 01:41:58.038007 19140 raft_consensus.cc:2454] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16d20cb32f4042d5a8d145b4b5086ea4 in term 0.
I20260810 01:41:58.038254 18797 leader_election.cc:302] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16d20cb32f4042d5a8d145b4b5086ea4, e5d49cd5d09249409ec8889da28f9188; no voters:
I20260810 01:41:58.038429 19248 raft_consensus.cc:2781] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:41:58.038488 19248 raft_consensus.cc:482] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:41:58.038532 19248 raft_consensus.cc:3037] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:58.039682 19248 raft_consensus.cc:504] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:58.039997 19248 leader_election.cc:288] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [CANDIDATE]: Term 1 election: Requested vote from peers e5d49cd5d09249409ec8889da28f9188 (127.16.58.65:36737), 22076eab491e44ca8c232288b533a564 (127.16.58.67:43271)
I20260810 01:41:58.040277 18684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d514f38120024405b50d896c081c4ccb" candidate_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d49cd5d09249409ec8889da28f9188"
I20260810 01:41:58.040392 18684 raft_consensus.cc:3037] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:58.040369 19140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d514f38120024405b50d896c081c4ccb" candidate_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22076eab491e44ca8c232288b533a564"
I20260810 01:41:58.040463 19140 raft_consensus.cc:3037] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:58.041442 18684 raft_consensus.cc:2454] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16d20cb32f4042d5a8d145b4b5086ea4 in term 1.
I20260810 01:41:58.041482 19140 raft_consensus.cc:2454] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16d20cb32f4042d5a8d145b4b5086ea4 in term 1.
I20260810 01:41:58.041707 18797 leader_election.cc:302] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16d20cb32f4042d5a8d145b4b5086ea4, 22076eab491e44ca8c232288b533a564; no voters:
I20260810 01:41:58.041901 19248 raft_consensus.cc:2781] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:58.041986 19248 raft_consensus.cc:686] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 LEADER]: Becoming Leader. State: Replica: 16d20cb32f4042d5a8d145b4b5086ea4, State: Running, Role: LEADER
I20260810 01:41:58.042117 19248 consensus_queue.cc:237] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } }
I20260810 01:41:58.042762 19285 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: TxnStatusTablet state changed. Reason: New leader 16d20cb32f4042d5a8d145b4b5086ea4. Latest consensus state: current_term: 1 leader_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:58.042855 19285 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:41:58.043166 19301 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 01:41:58.043311 19301 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 01:41:58.043715 18410 catalog_manager.cc:5495] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16d20cb32f4042d5a8d145b4b5086ea4 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } health_report { overall_health: UNKNOWN } } }
I20260810 01:41:58.072194 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:58.068513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41988 (local address 127.16.58.66:42793)
0810 01:41:58.068629 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:58.068632 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:58.068660 (+ 28us) server_negotiation.cc:407] Connection header received
0810 01:41:58.068851 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:58.068853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:58.068903 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:58.068979 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:58.069219 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.069700 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.070878 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.071075 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.071140 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:58.071437 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:58.071866 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:58.071948 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:58.072044 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 01:41:58.072089 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:41:58.072256 19292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:58.068397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42793 (local address 127.0.0.1:41988)
0810 01:41:58.068592 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:58.068607 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:58.068725 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:58.069007 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:58.069010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:58.069018 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:41:58.069127 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:58.069133 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.069789 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.069793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:58.070779 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:58.070790 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.071163 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.071166 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:58.071257 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:58.071311 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:41:58.071945 (+ 634us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:41:58.071960 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 01:41:58.072030 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:41:58.072115 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260810 01:41:58.074965 18684 raft_consensus.cc:1261] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Refusing update from remote peer 16d20cb32f4042d5a8d145b4b5086ea4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:58.075168 19140 raft_consensus.cc:1261] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564 [term 1 FOLLOWER]: Refusing update from remote peer 16d20cb32f4042d5a8d145b4b5086ea4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:58.075490 19285 consensus_queue.cc:1035] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:58.075685 19248 consensus_queue.cc:1035] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:58.077304 19266 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: TxnStatusTablet state changed. Reason: New leader 16d20cb32f4042d5a8d145b4b5086ea4. Latest consensus state: current_term: 1 leader_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:58.077409 19266 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:41:58.078500 19248 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:58.078599 19248 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:41:58.078691 19256 mvcc.cc:205] Tried to move back new op lower bound from 7316791779630231552 to 7316791779501735936. Current Snapshot: MvccSnapshot[applied={T|T < 7316791779630231552}]
I20260810 01:41:58.079862 19266 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:58.079970 19266 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P 22076eab491e44ca8c232288b533a564: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:41:58.081498 19249 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: TxnStatusTablet state changed. Reason: New leader 16d20cb32f4042d5a8d145b4b5086ea4. Latest consensus state: current_term: 1 leader_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:58.081620 19249 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:41:58.082275 19285 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:58.082373 19285 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P 16d20cb32f4042d5a8d145b4b5086ea4: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:41:58.084014 19249 tablet_replica.cc:439] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 } } peers { permanent_uuid: "16d20cb32f4042d5a8d145b4b5086ea4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42793 } } peers { permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 } } }
I20260810 01:41:58.084196 19249 tablet_replica.cc:442] T d514f38120024405b50d896c081c4ccb P e5d49cd5d09249409ec8889da28f9188: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:41:58.087136 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:58.083846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41992 (local address 127.16.58.66:42793)
0810 01:41:58.083942 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:58.083946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:58.083959 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:41:58.083996 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:58.083998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:58.084042 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:58.084110 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:58.084447 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.085067 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.086208 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.086425 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.086507 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:58.086757 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:58.086823 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:58.086879 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:58.086976 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 01:41:58.087022 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 01:41:58.096930 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:58.093937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:40889 (local address 127.16.58.66:42793)
0810 01:41:58.094028 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:58.094032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:58.094205 (+ 173us) server_negotiation.cc:407] Connection header received
0810 01:41:58.094327 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:58.094329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:58.094361 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:58.094413 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:41:58.094660 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.095106 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.095948 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.096148 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.096229 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:58.096541 (+ 312us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:41:58.096598 (+ 57us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:41:58.096655 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:58.096736 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 01:41:58.096779 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":31}
I20260810 01:41:58.096948 19310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:58.093886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42793 (local address 127.16.58.66:40889)
0810 01:41:58.094134 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:58.094145 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:58.094237 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:58.094426 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:58.094429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:58.094435 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:41:58.094568 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:58.094573 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.095205 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.095208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:58.095849 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:58.095860 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.096239 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.096243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:58.096371 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:58.096428 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:41:58.096668 (+ 240us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:41:58.096674 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:41:58.096730 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 01:41:58.096799 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":46,"thread_start_us":98,"threads_started":1}
I20260810 01:41:58.102931 19140 raft_consensus.cc:1261] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [term 1 FOLLOWER]: Refusing update from remote peer 16d20cb32f4042d5a8d145b4b5086ea4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:58.102991 18684 raft_consensus.cc:1261] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Refusing update from remote peer 16d20cb32f4042d5a8d145b4b5086ea4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:41:58.103312 19248 consensus_queue.cc:1035] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d49cd5d09249409ec8889da28f9188" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:58.103578 19285 consensus_queue.cc:1035] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22076eab491e44ca8c232288b533a564" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:41:58.139048 18411 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:58.139186 18411 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:41:58.140993 18411 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ba62e0364dd4fc3a151a164679a16f2: Sending DeleteTablet for 3 replicas of tablet 183e638ab1914a9fb325cfe323a54316
I20260810 01:41:58.141523 19108 tablet_service.cc:1514] Processing DeleteTablet for tablet 183e638ab1914a9fb325cfe323a54316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:58 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:60170
I20260810 01:41:58.141532 18863 tablet_service.cc:1514] Processing DeleteTablet for tablet 183e638ab1914a9fb325cfe323a54316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:58 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:41978
I20260810 01:41:58.141737 19277 tablet_replica.cc:330] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: stopping tablet replica
I20260810 01:41:58.141867 19277 raft_consensus.cc:2229] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:41:58.141964 19277 raft_consensus.cc:2258] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:58.141961 18654 tablet_service.cc:1514] Processing DeleteTablet for tablet 183e638ab1914a9fb325cfe323a54316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:41:58 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:57986
I20260810 01:41:58.142104 19273 tablet_replica.cc:330] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: stopping tablet replica
I20260810 01:41:58.142127 19278 tablet_replica.cc:330] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: stopping tablet replica
I20260810 01:41:58.142206 19273 raft_consensus.cc:2229] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:41:58.142243 19278 raft_consensus.cc:2229] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:41:58.142354 19278 raft_consensus.cc:2258] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:58.142448 19273 raft_consensus.cc:2258] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:41:58.143288 19278 ts_tablet_manager.cc:1905] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:58.143411 19277 ts_tablet_manager.cc:1905] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:58.145787 19278 ts_tablet_manager.cc:1918] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:41:58.145856 19278 log.cc:1196] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/183e638ab1914a9fb325cfe323a54316
I20260810 01:41:58.146070 19278 ts_tablet_manager.cc:1939] T 183e638ab1914a9fb325cfe323a54316 P e5d49cd5d09249409ec8889da28f9188: Deleting consensus metadata
I20260810 01:41:58.146148 19277 ts_tablet_manager.cc:1918] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:41:58.146232 19277 log.cc:1196] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/183e638ab1914a9fb325cfe323a54316
I20260810 01:41:58.146467 19277 ts_tablet_manager.cc:1939] T 183e638ab1914a9fb325cfe323a54316 P 22076eab491e44ca8c232288b533a564: Deleting consensus metadata
I20260810 01:41:58.146672 18380 catalog_manager.cc:4841] TS e5d49cd5d09249409ec8889da28f9188 (127.16.58.65:36737): tablet 183e638ab1914a9fb325cfe323a54316 (table test-table [id=f0aa16a4650a494395a80ef06dba63d3]) successfully deleted
I20260810 01:41:58.147132 18380 catalog_manager.cc:4841] TS 22076eab491e44ca8c232288b533a564 (127.16.58.67:43271): tablet 183e638ab1914a9fb325cfe323a54316 (table test-table [id=f0aa16a4650a494395a80ef06dba63d3]) successfully deleted
I20260810 01:41:58.147230 19273 ts_tablet_manager.cc:1905] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:41:58.149544 19273 ts_tablet_manager.cc:1918] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:41:58.149613 19273 log.cc:1196] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/183e638ab1914a9fb325cfe323a54316
I20260810 01:41:58.149886 19273 ts_tablet_manager.cc:1939] T 183e638ab1914a9fb325cfe323a54316 P 16d20cb32f4042d5a8d145b4b5086ea4: Deleting consensus metadata
I20260810 01:41:58.150537 18382 catalog_manager.cc:4841] TS 16d20cb32f4042d5a8d145b4b5086ea4 (127.16.58.66:42793): tablet 183e638ab1914a9fb325cfe323a54316 (table test-table [id=f0aa16a4650a494395a80ef06dba63d3]) successfully deleted
Aug 10 01:41:58 dist-test-slave-jlzn krb5kdc[18339](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326117, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:41:58.157927 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:58.142830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57996 (local address 127.16.58.65:36737)
0810 01:41:58.142947 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:58.142952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:58.147004 (+ 4052us) server_negotiation.cc:407] Connection header received
0810 01:41:58.147052 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:58.147055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:58.147109 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:58.147192 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:58.148179 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.148893 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.150225 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.150626 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.150713 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:58.154677 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:58.154686 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:58.154698 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:58.154722 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:58.156276 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:58.156740 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:58.156745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:58.156746 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:58.156836 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:58.157076 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:58.157078 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:58.157079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:58.157320 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:58.157470 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:58.157690 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 01:41:58.157793 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260810 01:41:58.158483 18748 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57996
I20260810 01:41:58.166838 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:58.160095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44682 (local address 127.16.58.126:36877)
0810 01:41:58.160218 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:58.160222 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:58.160347 (+ 125us) server_negotiation.cc:407] Connection header received
0810 01:41:58.160455 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:58.160458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:58.160503 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:58.160566 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:58.161173 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.161687 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.162440 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:58.162666 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:58.162753 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:58.164030 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:58.164034 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:58.164037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:58.164064 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:58.165280 (+ 1216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:58.165665 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:58.165669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:58.165671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:58.165772 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:58.166032 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:58.166035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:58.166037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:58.166221 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:58.166339 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:58.166572 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 01:41:58.166684 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 01:41:58.167236 18411 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44682
I20260810 01:41:58.168533 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18532
I20260810 01:41:58.187857 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18773
I20260810 01:41:58.197186 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18990
I20260810 01:41:58.211907 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18359
2026-08-10T01:41:58Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2885 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:41:58 dist-test-slave-jlzn krb5kdc[19329](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:41:58 dist-test-slave-jlzn krb5kdc[19329](info): set up 2 sockets
Aug 10 01:41:58 dist-test-slave-jlzn krb5kdc[19329](info): commencing operation
krb5kdc: starting...
W20260810 01:41:59.332151 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:41:59 dist-test-slave-jlzn krb5kdc[19329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:41:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:41:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:41:59.446615 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:43321
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:43321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:59.552786 19345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:59.553017 19345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:59.553069 19345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:59.556955 19345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:41:59.557003 19345 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 01:41:59.557024 19345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:59.557047 19345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:59.557076 19345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:41:59.557104 19345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:41:59.562052 19345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:43321
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:43321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:59.562956 19345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:59.563884 19345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:59.571568 19361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:59.571589 19359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:59.571573 19353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:59.571892 19345 server_base.cc:1034] running on GCE node
I20260810 01:41:59.572427 19345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:59.573413 19345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:59.574568 19345 hybrid_clock.cc:648] HybridClock initialized: now 1786326119574550 us; error 27 us; skew 500 ppm
Aug 10 01:41:59 dist-test-slave-jlzn krb5kdc[19329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326119, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:59.577158 19345 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:41:59.578068 19345 webserver.cc:460] Webserver started at http://127.16.58.126:38289/ using document root <none> and password file <none>
I20260810 01:41:59.578580 19345 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:59.578650 19345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:59.578835 19345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:59.580853 19345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "d8744ce0f2f64cb8ad1d276519f1a54c"
format_stamp: "Formatted at 2026-08-10 01:41:59 on dist-test-slave-jlzn"
server_key: "971ed74d359070a704d8fc5d7a8eb1fb"
server_key_iv: "b1cd1f703561ec91b871bc818dd6e94c"
server_key_version: "encryptionkey@0"
I20260810 01:41:59.581409 19345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "d8744ce0f2f64cb8ad1d276519f1a54c"
format_stamp: "Formatted at 2026-08-10 01:41:59 on dist-test-slave-jlzn"
server_key: "971ed74d359070a704d8fc5d7a8eb1fb"
server_key_iv: "b1cd1f703561ec91b871bc818dd6e94c"
server_key_version: "encryptionkey@0"
I20260810 01:41:59.584856 19345 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 01:41:59.587041 19373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:59.588202 19345 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:41:59.588315 19345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "d8744ce0f2f64cb8ad1d276519f1a54c"
format_stamp: "Formatted at 2026-08-10 01:41:59 on dist-test-slave-jlzn"
server_key: "971ed74d359070a704d8fc5d7a8eb1fb"
server_key_iv: "b1cd1f703561ec91b871bc818dd6e94c"
server_key_version: "encryptionkey@0"
I20260810 01:41:59.588404 19345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:59.609792 19345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:59.612767 19345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:59.612931 19345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:59.620179 19345 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:43321
I20260810 01:41:59.620221 19460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:43321 every 8 connection(s)
I20260810 01:41:59.621045 19345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:41:59.621482 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 19345
I20260810 01:41:59.621598 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:41:59.621865 16617 external_mini_cluster.cc:1428] Setting key bd34fd671fba5a8d2ef2d67750a49bd1
I20260810 01:41:59.624024 19461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 01:41:59 dist-test-slave-jlzn krb5kdc[19329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:59.630198 19461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c: Bootstrap starting.
I20260810 01:41:59.632431 19461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c: Neither blocks nor log segments found. Creating new log.
I20260810 01:41:59.633806 19461 log.cc:824] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:41:59.635151 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:59.623140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44702 (local address 127.16.58.126:43321)
0810 01:41:59.623561 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:59.623575 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:59.623608 (+ 33us) server_negotiation.cc:407] Connection header received
0810 01:41:59.624289 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:59.624307 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:59.624606 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:59.624896 (+ 290us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:59.625670 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.626664 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.627493 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.627994 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.628143 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:59.630838 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:59.630842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:59.630853 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:59.630880 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:59.632423 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:59.632907 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:59.632912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:59.632916 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:59.633035 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:59.633323 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:59.633325 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:59.633326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:59.633673 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:59.633799 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:59.634154 (+ 355us) server_negotiation.cc:299] Negotiation successful
0810 01:41:59.634428 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":133,"threads_started":1}
I20260810 01:41:59.635754 19461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c: No bootstrap required, opened a new log
I20260810 01:41:59.638857 19461 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8744ce0f2f64cb8ad1d276519f1a54c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43321 } }
I20260810 01:41:59.639060 19461 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:41:59.639109 19461 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8744ce0f2f64cb8ad1d276519f1a54c, State: Initialized, Role: FOLLOWER
I20260810 01:41:59.639480 19461 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8744ce0f2f64cb8ad1d276519f1a54c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43321 } }
I20260810 01:41:59.639604 19461 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:41:59.639663 19461 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:41:59.639756 19461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:41:59.640591 19461 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8744ce0f2f64cb8ad1d276519f1a54c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43321 } }
I20260810 01:41:59.640914 19461 leader_election.cc:302] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8744ce0f2f64cb8ad1d276519f1a54c; no voters:
I20260810 01:41:59.641238 19461 leader_election.cc:288] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:41:59.641322 19470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:41:59.641496 19470 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [term 1 LEADER]: Becoming Leader. State: Replica: d8744ce0f2f64cb8ad1d276519f1a54c, State: Running, Role: LEADER
I20260810 01:41:59.641788 19470 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8744ce0f2f64cb8ad1d276519f1a54c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43321 } }
I20260810 01:41:59.642459 19461 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:41:59.643518 19475 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8744ce0f2f64cb8ad1d276519f1a54c. Latest consensus state: current_term: 1 leader_uuid: "d8744ce0f2f64cb8ad1d276519f1a54c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8744ce0f2f64cb8ad1d276519f1a54c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43321 } } }
I20260810 01:41:59.643525 19473 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8744ce0f2f64cb8ad1d276519f1a54c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8744ce0f2f64cb8ad1d276519f1a54c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43321 } } }
I20260810 01:41:59.643651 19475 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:59.643668 19473 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c [sys.catalog]: This master's current role is: LEADER
I20260810 01:41:59.644043 19487 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:41:59.647162 19487 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:41:59.652454 19487 catalog_manager.cc:1347] Generated new cluster ID: eda088bb915943b593ca0b2b3fb8b32d
I20260810 01:41:59.652515 19487 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:41:59.688133 19487 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:41:59.689327 19487 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:41:59.698626 19487 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c: Generated new TSK 0
I20260810 01:41:59.699368 19487 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:41:59.732400 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43321
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:41:59.840488 19506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:41:59.840739 19506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:41:59.840794 19506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:41:59.844812 19506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:41:59.844868 19506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:41:59.844915 19506 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 01:41:59.844944 19506 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:41:59.844995 19506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:41:59.850086 19506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.58.126:43321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:41:59.851037 19506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:41:59.852041 19506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:41:59.861161 19516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:59.861192 19519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:41:59.861191 19517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:41:59.861500 19506 server_base.cc:1034] running on GCE node
I20260810 01:41:59.861877 19506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:41:59.862433 19506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:41:59.863606 19506 hybrid_clock.cc:648] HybridClock initialized: now 1786326119863573 us; error 30 us; skew 500 ppm
Aug 10 01:41:59 dist-test-slave-jlzn krb5kdc[19329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326119, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:41:59.866333 19506 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:41:59.867138 19506 webserver.cc:460] Webserver started at http://127.16.58.65:35841/ using document root <none> and password file <none>
I20260810 01:41:59.867650 19506 fs_manager.cc:359] Metadata directory not provided
I20260810 01:41:59.867717 19506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:41:59.867936 19506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:41:59.869865 19506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "fb2d2da866c046fc9d09ec6a16974f83"
format_stamp: "Formatted at 2026-08-10 01:41:59 on dist-test-slave-jlzn"
server_key: "7dfa2333eb158958a9535d4f0a2f60ca"
server_key_iv: "0c3efae8f9b3a52d0ea723f15272814b"
server_key_version: "encryptionkey@0"
I20260810 01:41:59.870398 19506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "fb2d2da866c046fc9d09ec6a16974f83"
format_stamp: "Formatted at 2026-08-10 01:41:59 on dist-test-slave-jlzn"
server_key: "7dfa2333eb158958a9535d4f0a2f60ca"
server_key_iv: "0c3efae8f9b3a52d0ea723f15272814b"
server_key_version: "encryptionkey@0"
I20260810 01:41:59.873843 19506 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:41:59.875979 19528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:59.877071 19506 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:41:59.877188 19506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "fb2d2da866c046fc9d09ec6a16974f83"
format_stamp: "Formatted at 2026-08-10 01:41:59 on dist-test-slave-jlzn"
server_key: "7dfa2333eb158958a9535d4f0a2f60ca"
server_key_iv: "0c3efae8f9b3a52d0ea723f15272814b"
server_key_version: "encryptionkey@0"
I20260810 01:41:59.877278 19506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:41:59.897662 19506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:41:59.900203 19506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:41:59.900367 19506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:41:59.901750 19506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:41:59.901801 19506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:41:59.901854 19506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:41:59.901885 19506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:41:59 dist-test-slave-jlzn krb5kdc[19329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326119, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:41:59.912220 19506 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:42321
I20260810 01:41:59.912469 19700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:42321 every 8 connection(s)
I20260810 01:41:59.913244 19506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:41:59.914935 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:59.902402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:53161 (local address 127.16.58.126:43321)
0810 01:41:59.902520 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:59.902524 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:59.904056 (+ 1532us) server_negotiation.cc:407] Connection header received
0810 01:41:59.905138 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:59.905141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:59.905202 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:59.905278 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:59.906418 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.906996 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.908205 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.908460 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.908551 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:59.911376 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:59.911379 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:59.911381 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:59.911406 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:59.913016 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:59.913539 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:59.913543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:59.913545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:59.913646 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:59.914029 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:59.914033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:59.914035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:59.914241 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:59.914321 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:59.914715 (+ 394us) server_negotiation.cc:299] Negotiation successful
0810 01:41:59.914815 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 01:41:59.915618 19539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:59.903420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43321 (local address 127.16.58.65:53161)
0810 01:41:59.903918 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:59.903960 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:59.904928 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:59.905449 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:59.905455 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:59.905818 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:59.906264 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:59.906277 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.907123 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.907127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:59.908048 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:59.908062 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.908610 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.908616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:59.908828 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:59.909363 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:59.909381 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:59.911214 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:59.913140 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:59.913145 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:59.913155 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:59.913442 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:59.913764 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:59.913768 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:59.913770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:59.913937 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:59.914325 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:59.914329 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:59.914535 (+ 206us) client_negotiation.cc:769] Sending connection context
0810 01:41:59.914678 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 01:41:59.914902 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":121,"threads_started":1}
I20260810 01:41:59.916749 19701 heartbeater.cc:347] Connected to a master server at 127.16.58.126:43321
I20260810 01:41:59.916893 19701 heartbeater.cc:464] Registering TS with master...
I20260810 01:41:59.917405 19701 heartbeater.cc:511] Master 127.16.58.126:43321 requested a full tablet report, sending...
I20260810 01:41:59.918397 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 19506
I20260810 01:41:59.918520 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:41:59.918835 16617 external_mini_cluster.cc:1428] Setting key 57d00919c13fa3728379776520054ae0
I20260810 01:41:59.918944 19391 ts_manager.cc:194] Registered new tserver with Master: fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321)
I20260810 01:41:59.920418 19391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:53161
I20260810 01:41:59.925909 19710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:59.918944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43321 (local address 127.16.58.65:42263)
0810 01:41:59.919310 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0810 01:41:59.919323 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:41:59.919447 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:41:59.919696 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:41:59.919699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:41:59.919923 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:41:59.920043 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:59.920050 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.920853 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.920856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:59.921591 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:41:59.921602 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.922233 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.922236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:41:59.922306 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:59.922708 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:41:59.922718 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:41:59.923000 (+ 282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:41:59.924620 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:59.924623 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:59.924624 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:59.924802 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:59.925052 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:41:59.925054 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:41:59.925055 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:41:59.925126 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:41:59.925516 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:41:59.925519 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:41:59.925603 (+ 84us) client_negotiation.cc:769] Sending connection context
0810 01:41:59.925681 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:41:59.925775 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":101,"threads_started":1}
I20260810 01:41:59.926007 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:41:59.919033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:42263 (local address 127.16.58.126:43321)
0810 01:41:59.919146 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:41:59.919150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:41:59.919383 (+ 233us) server_negotiation.cc:407] Connection header received
0810 01:41:59.919537 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:41:59.919540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:41:59.919581 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:41:59.919667 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:41:59.920203 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.920727 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.921714 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:41:59.922009 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:41:59.922119 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:41:59.923130 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:41:59.923134 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:41:59.923137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:41:59.923162 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:41:59.924521 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:59.924889 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:59.924892 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:59.924893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:59.924977 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:41:59.925212 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:41:59.925215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:41:59.925217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:41:59.925421 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:41:59.925521 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 01:41:59.925755 (+ 234us) server_negotiation.cc:299] Negotiation successful
0810 01:41:59.925863 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:41:59.944408 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43321
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:00.050302 19714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:00.050522 19714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:00.050572 19714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:00.054471 19714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:00.054520 19714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:00.054567 19714 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 01:42:00.054596 19714 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:42:00.054644 19714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:00.059612 19714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.58.126:43321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:00.060497 19714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:00.061371 19714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:00.070144 19722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:00.070152 19723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:00.070159 19726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:00.070317 19714 server_base.cc:1034] running on GCE node
I20260810 01:42:00.070727 19714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:00.071271 19714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:00.072424 19714 hybrid_clock.cc:648] HybridClock initialized: now 1786326120072401 us; error 34 us; skew 500 ppm
Aug 10 01:42:00 dist-test-slave-jlzn krb5kdc[19329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326120, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:00.074932 19714 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:42:00.075680 19714 webserver.cc:460] Webserver started at http://127.16.58.66:35081/ using document root <none> and password file <none>
I20260810 01:42:00.076195 19714 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:00.076263 19714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:00.076459 19714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:00.078290 19714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "54a50d7d7fcd4847bc965ee48ab524e2"
format_stamp: "Formatted at 2026-08-10 01:42:00 on dist-test-slave-jlzn"
server_key: "c7753b7456ef9d318ba53b3dfdac8a8a"
server_key_iv: "18c6e26744071bda07f2d34867547779"
server_key_version: "encryptionkey@0"
I20260810 01:42:00.078835 19714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "54a50d7d7fcd4847bc965ee48ab524e2"
format_stamp: "Formatted at 2026-08-10 01:42:00 on dist-test-slave-jlzn"
server_key: "c7753b7456ef9d318ba53b3dfdac8a8a"
server_key_iv: "18c6e26744071bda07f2d34867547779"
server_key_version: "encryptionkey@0"
I20260810 01:42:00.082283 19714 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 01:42:00.084441 19746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:00.085500 19714 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:00.085618 19714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "54a50d7d7fcd4847bc965ee48ab524e2"
format_stamp: "Formatted at 2026-08-10 01:42:00 on dist-test-slave-jlzn"
server_key: "c7753b7456ef9d318ba53b3dfdac8a8a"
server_key_iv: "18c6e26744071bda07f2d34867547779"
server_key_version: "encryptionkey@0"
I20260810 01:42:00.085723 19714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:00.098335 19714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:00.100802 19714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:00.100956 19714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:00.102224 19714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:00.102272 19714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:00.102322 19714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:00.102348 19714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:42:00 dist-test-slave-jlzn krb5kdc[19329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326120, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:00.112428 19714 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:34121
I20260810 01:42:00.112502 19929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:34121 every 8 connection(s)
I20260810 01:42:00.113238 19714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:00.115159 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.102950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:56351 (local address 127.16.58.126:43321)
0810 01:42:00.103059 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.103063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.104031 (+ 968us) server_negotiation.cc:407] Connection header received
0810 01:42:00.104969 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.104973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.105035 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.105138 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:00.106286 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.106914 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.108088 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.108314 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.108404 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.111751 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:00.111755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:00.111758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:00.111787 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:00.113314 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.113886 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.113889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.113891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.113990 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.114304 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.114306 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.114307 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.114468 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:00.114541 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.114938 (+ 397us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.115032 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 01:42:00.115917 19756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.103436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43321 (local address 127.16.58.66:56351)
0810 01:42:00.103904 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.103945 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.104741 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.105369 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.105378 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.105723 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:00.106144 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.106157 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.107043 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.107046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.107971 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.107982 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.108463 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.108467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.108617 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.109186 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:00.109208 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:00.111585 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:00.113415 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.113421 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.113433 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.113764 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.114082 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.114086 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.114088 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.114231 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.114539 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:00.114544 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:00.114750 (+ 206us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.114888 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.115172 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":118,"threads_started":1}
I20260810 01:42:00.116989 19930 heartbeater.cc:347] Connected to a master server at 127.16.58.126:43321
I20260810 01:42:00.117123 19930 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:00.117549 19930 heartbeater.cc:511] Master 127.16.58.126:43321 requested a full tablet report, sending...
I20260810 01:42:00.118567 19395 ts_manager.cc:194] Registered new tserver with Master: 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66:34121)
I20260810 01:42:00.119263 19395 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:56351
I20260810 01:42:00.119380 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 19714
I20260810 01:42:00.119485 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:00.119755 16617 external_mini_cluster.cc:1428] Setting key ed5f115e7cc5b71ba18f1117d786a0a0
I20260810 01:42:00.126155 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.119124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:38251 (local address 127.16.58.126:43321)
0810 01:42:00.120151 (+ 1027us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.120155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.120168 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:00.120200 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.120203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.120245 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.120309 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:00.120716 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.121242 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.122003 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.122214 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.122295 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.123351 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:00.123354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:00.123355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:00.123377 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:00.124612 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.125030 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.125032 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.125033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.125097 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.125377 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.125379 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.125380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.125621 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:00.125701 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.125954 (+ 253us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.126038 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":943}
I20260810 01:42:00.126235 19943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.119035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43321 (local address 127.16.58.66:38251)
0810 01:42:00.119326 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.119339 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.119419 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.120345 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.120348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.120513 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:00.120603 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.120609 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.121358 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.121360 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.121899 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.121907 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.122309 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.122312 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.122399 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.122833 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:00.122848 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:00.123225 (+ 377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:00.124717 (+ 1492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.124720 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.124722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.124945 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.125181 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.125185 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.125187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.125299 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.125714 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:00.125717 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:00.125811 (+ 94us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.125915 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.126048 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:42:00.144390 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43321
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:00.250385 19947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:00.250620 19947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:00.250682 19947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:00.254614 19947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:00.254673 19947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:00.254726 19947 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 01:42:00.254753 19947 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:42:00.254801 19947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:00.260005 19947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.58.126:43321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:00.260924 19947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:00.261850 19947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:00.270932 19960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:00.271044 19947 server_base.cc:1034] running on GCE node
W20260810 01:42:00.270956 19958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:00.270956 19956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:00.271574 19947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:00.272190 19947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:00.273345 19947 hybrid_clock.cc:648] HybridClock initialized: now 1786326120273329 us; error 31 us; skew 500 ppm
Aug 10 01:42:00 dist-test-slave-jlzn krb5kdc[19329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326120, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:00.275854 19947 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:42:00.276623 19947 webserver.cc:460] Webserver started at http://127.16.58.67:46023/ using document root <none> and password file <none>
I20260810 01:42:00.277113 19947 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:00.277186 19947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:00.277377 19947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:00.279237 19947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "f74db761e7b54099823e9d3ceac2a75c"
format_stamp: "Formatted at 2026-08-10 01:42:00 on dist-test-slave-jlzn"
server_key: "5220b392ebe06947647453c1be32beac"
server_key_iv: "5bf1a32694895e9f06c07d9333af50c3"
server_key_version: "encryptionkey@0"
I20260810 01:42:00.279750 19947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "f74db761e7b54099823e9d3ceac2a75c"
format_stamp: "Formatted at 2026-08-10 01:42:00 on dist-test-slave-jlzn"
server_key: "5220b392ebe06947647453c1be32beac"
server_key_iv: "5bf1a32694895e9f06c07d9333af50c3"
server_key_version: "encryptionkey@0"
I20260810 01:42:00.283205 19947 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:42:00.285400 19969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:00.286489 19947 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260810 01:42:00.286594 19947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "f74db761e7b54099823e9d3ceac2a75c"
format_stamp: "Formatted at 2026-08-10 01:42:00 on dist-test-slave-jlzn"
server_key: "5220b392ebe06947647453c1be32beac"
server_key_iv: "5bf1a32694895e9f06c07d9333af50c3"
server_key_version: "encryptionkey@0"
I20260810 01:42:00.286687 19947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:00.299309 19947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:00.301690 19947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:00.301851 19947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:00.303159 19947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:00.303210 19947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:00.303260 19947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:00.303289 19947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:42:00 dist-test-slave-jlzn krb5kdc[19329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326120, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:00.313402 19947 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:43649
I20260810 01:42:00.313427 20142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:43649 every 8 connection(s)
I20260810 01:42:00.314236 19947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:00.315699 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.303780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:36743 (local address 127.16.58.126:43321)
0810 01:42:00.303947 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.303951 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.305004 (+ 1053us) server_negotiation.cc:407] Connection header received
0810 01:42:00.305829 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.305833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.305893 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.305962 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:00.307164 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.307743 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.308989 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.309299 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.309400 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.312445 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:00.312449 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:00.312452 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:00.312479 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:00.313843 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.314300 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.314304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.314306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.314399 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.314768 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.314771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.314773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.314985 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:00.315065 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.315491 (+ 426us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.315581 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260810 01:42:00.316449 19984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.304410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43321 (local address 127.16.58.67:36743)
0810 01:42:00.304872 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.304910 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.305643 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.306141 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.306150 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.306546 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:00.307018 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.307030 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.307874 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.307878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.308873 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.308883 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.309429 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.309433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.309591 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.310070 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:00.310092 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:00.312293 (+ 2201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:00.313945 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.313951 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.313964 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.314208 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.314481 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.314484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.314486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.314656 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.315090 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:00.315097 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:00.315300 (+ 203us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.315455 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.315685 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":136,"threads_started":1}
I20260810 01:42:00.317579 20144 heartbeater.cc:347] Connected to a master server at 127.16.58.126:43321
I20260810 01:42:00.317713 20144 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:00.318138 20144 heartbeater.cc:511] Master 127.16.58.126:43321 requested a full tablet report, sending...
I20260810 01:42:00.319149 19391 ts_manager.cc:194] Registered new tserver with Master: f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:00.319382 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 19947
I20260810 01:42:00.319496 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:00.319849 16617 external_mini_cluster.cc:1428] Setting key 780a99b8c1ca436d4e5e79eb94189486
I20260810 01:42:00.319864 19391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:36743
I20260810 01:42:00.321718 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:42:00.326880 20151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.319498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43321 (local address 127.16.58.67:47277)
0810 01:42:00.319776 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.319790 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.319898 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.320454 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.320457 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.320688 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:00.320830 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.320838 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.321805 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.321808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.322606 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.322617 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.323032 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.323036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.323125 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.323514 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:00.323528 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:00.323934 (+ 406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:00.325668 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.325671 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.325672 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.325851 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.326112 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.326114 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.326115 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.326182 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.326519 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:00.326521 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:00.326590 (+ 69us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.326659 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.326754 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":18,"thread_start_us":111,"threads_started":1}
I20260810 01:42:00.326992 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.320158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:47277 (local address 127.16.58.126:43321)
0810 01:42:00.320265 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.320269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.320280 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:42:00.320311 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.320313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.320351 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.320429 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:00.320953 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.321675 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.322728 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.322929 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.322997 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.324072 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:00.324077 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:00.324080 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:00.324108 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:00.325566 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.325940 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.325944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.325946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.326031 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.326251 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.326254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.326255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.326444 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:00.326534 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.326725 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.326846 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 01:42:00 dist-test-slave-jlzn krb5kdc[19329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:42:00 dist-test-slave-jlzn krb5kdc[19329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:00.346966 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.340186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44712 (local address 127.16.58.126:43321)
0810 01:42:00.340301 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.340304 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.340316 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:00.340346 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.340348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.340381 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.340441 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:00.341037 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.341523 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.342273 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.342463 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.342561 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.344680 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:00.344683 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:00.344685 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:00.344707 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:00.345829 (+ 1122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.346163 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.346166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.346167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.346229 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.346401 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.346402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.346403 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.346538 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:00.346630 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.346779 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.346860 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:00.349355 19391 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:00.352193 19391 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:00.365327 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.359675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34121 (local address 127.0.0.1:51708)
0810 01:42:00.359999 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.360045 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.360177 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.361207 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.361213 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.361238 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:00.361371 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.361378 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.362813 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.362816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.363970 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.363980 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.364943 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.364945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.365019 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.365048 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.365114 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.365198 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":36,"thread_start_us":68,"threads_started":1}
I20260810 01:42:00.365373 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.360307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51708 (local address 127.16.58.66:34121)
0810 01:42:00.360691 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.360702 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.360725 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:42:00.360804 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.360809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.361008 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.361521 (+ 513us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:00.361649 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.362709 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.364167 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.364839 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.364946 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.365096 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.365147 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.365231 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":100,"threads_started":1}
I20260810 01:42:00.365835 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.360743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:43649 (local address 127.0.0.1:42808)
0810 01:42:00.361249 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.361260 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.361342 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.361842 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.361845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.361863 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:00.361947 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.361953 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.363145 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.363148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.364348 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.364360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.365447 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.365451 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.365551 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.365574 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.365652 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.365719 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":85,"threads_started":1}
I20260810 01:42:00.366312 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.360883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42808 (local address 127.16.58.67:43649)
0810 01:42:00.361242 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.361253 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.361319 (+ 66us) server_negotiation.cc:407] Connection header received
0810 01:42:00.361434 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.361439 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.361609 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.361763 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:00.362058 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.363027 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.364475 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.365243 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.365336 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.365476 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.366094 (+ 618us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.366183 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":90,"threads_started":1}
I20260810 01:42:00.366897 20173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.360393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42321 (local address 127.0.0.1:41836)
0810 01:42:00.361051 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.361063 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.361162 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.361599 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.361602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.361619 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:00.361720 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.361727 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.362715 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.362718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.364368 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.364375 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.366526 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.366530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.366618 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.366641 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.366707 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.366772 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"mutex_wait_us":306,"thread_start_us":100,"threads_started":1}
I20260810 01:42:00.366964 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.360056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41836 (local address 127.16.58.65:42321)
0810 01:42:00.361079 (+ 1023us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.361092 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.361114 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:42:00.361312 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.361318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.361486 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.361609 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:00.361827 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.362612 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.365534 (+ 2922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.366216 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.366318 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.366467 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.366754 (+ 287us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.366840 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":936,"thread_start_us":125,"threads_started":1}
I20260810 01:42:00.368422 19824 tablet_service.cc:1467] Processing CreateTablet for tablet 1dc5b578549246019b6ef064ccdce7f3 (DEFAULT_TABLE table=test-table [id=c50d3b8108184225a4a6b5bb03b2f126]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:00.369280 20050 tablet_service.cc:1467] Processing CreateTablet for tablet 1dc5b578549246019b6ef064ccdce7f3 (DEFAULT_TABLE table=test-table [id=c50d3b8108184225a4a6b5bb03b2f126]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:00.369563 19824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dc5b578549246019b6ef064ccdce7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:00.369544 19604 tablet_service.cc:1467] Processing CreateTablet for tablet 1dc5b578549246019b6ef064ccdce7f3 (DEFAULT_TABLE table=test-table [id=c50d3b8108184225a4a6b5bb03b2f126]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:00.370067 20050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dc5b578549246019b6ef064ccdce7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:00.370463 19604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dc5b578549246019b6ef064ccdce7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:00.375910 20179 tablet_bootstrap.cc:492] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: Bootstrap starting.
I20260810 01:42:00.377030 20180 tablet_bootstrap.cc:492] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: Bootstrap starting.
I20260810 01:42:00.378068 20179 tablet_bootstrap.cc:654] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:00.378098 20181 tablet_bootstrap.cc:492] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: Bootstrap starting.
I20260810 01:42:00.378971 20179 log.cc:824] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:00.379107 20180 tablet_bootstrap.cc:654] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:00.379870 20180 log.cc:824] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:00.380097 20181 tablet_bootstrap.cc:654] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:00.380954 20181 log.cc:824] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:00.381460 20179 tablet_bootstrap.cc:492] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: No bootstrap required, opened a new log
I20260810 01:42:00.381659 20179 ts_tablet_manager.cc:1397] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:42:00.382190 20180 tablet_bootstrap.cc:492] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: No bootstrap required, opened a new log
I20260810 01:42:00.382371 20180 ts_tablet_manager.cc:1397] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:42:00.382604 20181 tablet_bootstrap.cc:492] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: No bootstrap required, opened a new log
I20260810 01:42:00.382772 20181 ts_tablet_manager.cc:1397] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:42:00.385474 20179 raft_consensus.cc:348] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.385740 20179 raft_consensus.cc:374] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:00.385665 20181 raft_consensus.cc:348] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.385825 20179 raft_consensus.cc:729] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f74db761e7b54099823e9d3ceac2a75c, State: Initialized, Role: FOLLOWER
I20260810 01:42:00.385890 20181 raft_consensus.cc:374] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:00.385946 20181 raft_consensus.cc:729] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb2d2da866c046fc9d09ec6a16974f83, State: Initialized, Role: FOLLOWER
I20260810 01:42:00.386268 20179 consensus_queue.cc:260] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.386201 20180 raft_consensus.cc:348] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.386312 20181 consensus_queue.cc:260] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.386413 20180 raft_consensus.cc:374] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:00.386493 20180 raft_consensus.cc:729] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a50d7d7fcd4847bc965ee48ab524e2, State: Initialized, Role: FOLLOWER
I20260810 01:42:00.386875 20180 consensus_queue.cc:260] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.387156 20181 ts_tablet_manager.cc:1428] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260810 01:42:00.387189 20179 ts_tablet_manager.cc:1428] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:42:00.387517 19701 heartbeater.cc:503] Master 127.16.58.126:43321 was elected leader, sending a full tablet report...
I20260810 01:42:00.387517 19930 heartbeater.cc:503] Master 127.16.58.126:43321 was elected leader, sending a full tablet report...
I20260810 01:42:00.387727 20180 ts_tablet_manager.cc:1428] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:42:00.388072 20144 heartbeater.cc:503] Master 127.16.58.126:43321 was elected leader, sending a full tablet report...
W20260810 01:42:00.414307 19703 tablet.cc:2369] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:00.432498 20189 raft_consensus.cc:482] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:00.432655 20189 raft_consensus.cc:504] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.433599 20189 leader_election.cc:288] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:00.437204 19756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.433824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42321 (local address 127.16.58.66:48875)
0810 01:42:00.433950 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.433965 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.434049 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.434338 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.434342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.434360 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:00.434474 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.434481 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.435230 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.435233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.436219 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.436230 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.436809 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.436813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.436913 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.436963 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.437028 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.437095 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":6}
I20260810 01:42:00.437268 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.433878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:48875 (local address 127.16.58.65:42321)
0810 01:42:00.433993 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.433997 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.434010 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:00.434153 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.434156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.434198 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.434265 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:00.434567 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.435114 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.436327 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.436708 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.436814 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.436866 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.437071 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.437152 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:42:00.437813 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.434169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:54925 (local address 127.16.58.67:43649)
0810 01:42:00.434294 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.434299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.434441 (+ 142us) server_negotiation.cc:407] Connection header received
0810 01:42:00.434539 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.434542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.434583 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.434661 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:00.435193 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.435688 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.436820 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.437350 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.437458 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.437501 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.437677 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.437730 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:00.437774 19638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc5b578549246019b6ef064ccdce7f3" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2d2da866c046fc9d09ec6a16974f83" is_pre_election: true
I20260810 01:42:00.437860 20190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.434068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:43649 (local address 127.16.58.66:54925)
0810 01:42:00.434362 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.434374 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.434464 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.434668 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.434670 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.434685 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:00.434779 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.434783 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.435788 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.435791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.436692 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.436702 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.437466 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.437469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.437566 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.437589 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.437666 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.437731 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":106,"threads_started":1}
I20260810 01:42:00.438024 19638 raft_consensus.cc:2454] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 0.
I20260810 01:42:00.438478 19750 leader_election.cc:302] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a50d7d7fcd4847bc965ee48ab524e2, fb2d2da866c046fc9d09ec6a16974f83; no voters:
I20260810 01:42:00.438488 20078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc5b578549246019b6ef064ccdce7f3" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c" is_pre_election: true
I20260810 01:42:00.438692 20078 raft_consensus.cc:2454] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 0.
I20260810 01:42:00.438714 20189 raft_consensus.cc:2781] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:00.438783 20189 raft_consensus.cc:482] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:00.438829 20189 raft_consensus.cc:3037] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:00.439899 20189 raft_consensus.cc:504] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.440192 20189 leader_election.cc:288] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 election: Requested vote from peers fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:00.440491 19638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc5b578549246019b6ef064ccdce7f3" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2d2da866c046fc9d09ec6a16974f83"
I20260810 01:42:00.440524 20078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dc5b578549246019b6ef064ccdce7f3" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c"
I20260810 01:42:00.440583 19638 raft_consensus.cc:3037] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:00.440624 20078 raft_consensus.cc:3037] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:00.441454 19638 raft_consensus.cc:2454] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 1.
I20260810 01:42:00.441601 20078 raft_consensus.cc:2454] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 1.
I20260810 01:42:00.441726 19750 leader_election.cc:302] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a50d7d7fcd4847bc965ee48ab524e2, fb2d2da866c046fc9d09ec6a16974f83; no voters:
I20260810 01:42:00.441872 20189 raft_consensus.cc:2781] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:00.442067 20189 raft_consensus.cc:686] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 LEADER]: Becoming Leader. State: Replica: 54a50d7d7fcd4847bc965ee48ab524e2, State: Running, Role: LEADER
I20260810 01:42:00.442341 20189 consensus_queue.cc:237] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.445194 19389 catalog_manager.cc:5495] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } health_report { overall_health: UNKNOWN } } }
Aug 10 01:42:00 dist-test-slave-jlzn krb5kdc[19329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326119, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:00.492461 20202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.485070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43321 (local address 127.0.0.1:44714)
0810 01:42:00.485303 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.485315 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.485402 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.485581 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.485583 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.485940 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:00.486033 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.486038 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.486693 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.486696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.487223 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.487229 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.487557 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.487559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.487616 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.488111 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:00.488122 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:00.489488 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:00.491068 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.491077 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.491081 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.491354 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.491604 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:00.491606 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:00.491607 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:00.491688 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:00.492011 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:00.492016 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:00.492108 (+ 92us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.492195 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.492319 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":79,"threads_started":1}
I20260810 01:42:00.492491 19467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.485147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44714 (local address 127.16.58.126:43321)
0810 01:42:00.485271 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.485275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.485373 (+ 98us) server_negotiation.cc:407] Connection header received
0810 01:42:00.485465 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.485467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.485501 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.485560 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:00.486115 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.486616 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.487299 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.487488 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.487551 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.489603 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:00.489606 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:00.489608 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:00.489648 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:00.490968 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.491439 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.491442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.491444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.491536 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:00.491746 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:00.491748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:00.491749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:00.491937 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:00.492014 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.492229 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.492382 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":49}
I20260810 01:42:00.495581 19389 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:44714:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 01:42:00.496269 19389 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:00.500617 19824 tablet_service.cc:1467] Processing CreateTablet for tablet 9402b84850ae4cc694ef25c4814a893b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dcd0b27b5b234c27a1b4dbe9e95b0f0a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:42:00.500527 19604 tablet_service.cc:1467] Processing CreateTablet for tablet 9402b84850ae4cc694ef25c4814a893b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dcd0b27b5b234c27a1b4dbe9e95b0f0a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:42:00.501233 19604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9402b84850ae4cc694ef25c4814a893b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:00.501233 19824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9402b84850ae4cc694ef25c4814a893b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:00.500870 20050 tablet_service.cc:1467] Processing CreateTablet for tablet 9402b84850ae4cc694ef25c4814a893b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dcd0b27b5b234c27a1b4dbe9e95b0f0a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:42:00.501475 20050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9402b84850ae4cc694ef25c4814a893b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:00.503947 20179 tablet_bootstrap.cc:492] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: Bootstrap starting.
I20260810 01:42:00.504014 20180 tablet_bootstrap.cc:492] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: Bootstrap starting.
I20260810 01:42:00.504774 20179 tablet_bootstrap.cc:654] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:00.504845 20180 tablet_bootstrap.cc:654] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:00.505443 20181 tablet_bootstrap.cc:492] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: Bootstrap starting.
I20260810 01:42:00.505859 20179 tablet_bootstrap.cc:492] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: No bootstrap required, opened a new log
I20260810 01:42:00.505937 20179 ts_tablet_manager.cc:1397] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:00.506359 20179 raft_consensus.cc:348] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.506450 20179 raft_consensus.cc:374] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:00.506453 20181 tablet_bootstrap.cc:654] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:00.506479 20179 raft_consensus.cc:729] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f74db761e7b54099823e9d3ceac2a75c, State: Initialized, Role: FOLLOWER
I20260810 01:42:00.506608 20179 consensus_queue.cc:260] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.506860 20179 ts_tablet_manager.cc:1428] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:00.506860 20186 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.507005 20186 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:00.507510 20181 tablet_bootstrap.cc:492] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: No bootstrap required, opened a new log
I20260810 01:42:00.507602 20181 ts_tablet_manager.cc:1397] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:00.507784 20180 tablet_bootstrap.cc:492] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: No bootstrap required, opened a new log
I20260810 01:42:00.507916 20180 ts_tablet_manager.cc:1397] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 01:42:00.508069 20181 raft_consensus.cc:348] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.508191 20181 raft_consensus.cc:374] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:00.508229 20181 raft_consensus.cc:729] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb2d2da866c046fc9d09ec6a16974f83, State: Initialized, Role: FOLLOWER
I20260810 01:42:00.508342 20181 consensus_queue.cc:260] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.508350 20180 raft_consensus.cc:348] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.508448 20180 raft_consensus.cc:374] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:00.508486 20180 raft_consensus.cc:729] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a50d7d7fcd4847bc965ee48ab524e2, State: Initialized, Role: FOLLOWER
I20260810 01:42:00.508589 20181 ts_tablet_manager.cc:1428] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:00.508607 20180 consensus_queue.cc:260] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.508869 20180 ts_tablet_manager.cc:1428] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:00.508798 20187 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.508831 20189 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.508936 20189 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:00.508935 20187 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: This TxnStatusTablet replica's current role is: FOLLOWER
W20260810 01:42:00.565148 20146 tablet.cc:2369] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:42:00.614377 19932 tablet.cc:2369] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:00.618188 20189 raft_consensus.cc:482] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:00.618302 20189 raft_consensus.cc:504] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.618718 20189 leader_election.cc:288] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:00.619136 19638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9402b84850ae4cc694ef25c4814a893b" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2d2da866c046fc9d09ec6a16974f83" is_pre_election: true
I20260810 01:42:00.619205 20078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9402b84850ae4cc694ef25c4814a893b" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c" is_pre_election: true
I20260810 01:42:00.619288 19638 raft_consensus.cc:2454] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 0.
I20260810 01:42:00.619355 20078 raft_consensus.cc:2454] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 0.
I20260810 01:42:00.619568 19750 leader_election.cc:302] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a50d7d7fcd4847bc965ee48ab524e2, fb2d2da866c046fc9d09ec6a16974f83; no voters:
I20260810 01:42:00.619751 20189 raft_consensus.cc:2781] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:00.619850 20189 raft_consensus.cc:482] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:00.619899 20189 raft_consensus.cc:3037] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:00.620847 20189 raft_consensus.cc:504] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.621138 20189 leader_election.cc:288] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 election: Requested vote from peers fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:00.621460 20078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9402b84850ae4cc694ef25c4814a893b" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c"
I20260810 01:42:00.621498 19638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9402b84850ae4cc694ef25c4814a893b" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2d2da866c046fc9d09ec6a16974f83"
I20260810 01:42:00.621563 20078 raft_consensus.cc:3037] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:00.621613 19638 raft_consensus.cc:3037] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:00.622419 20078 raft_consensus.cc:2454] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 1.
I20260810 01:42:00.622681 19638 raft_consensus.cc:2454] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 1.
I20260810 01:42:00.622685 19750 leader_election.cc:302] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a50d7d7fcd4847bc965ee48ab524e2, f74db761e7b54099823e9d3ceac2a75c; no voters:
I20260810 01:42:00.622844 20189 raft_consensus.cc:2781] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:00.622927 20189 raft_consensus.cc:686] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 LEADER]: Becoming Leader. State: Replica: 54a50d7d7fcd4847bc965ee48ab524e2, State: Running, Role: LEADER
I20260810 01:42:00.623065 20189 consensus_queue.cc:237] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.623672 20189 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: TxnStatusTablet state changed. Reason: New leader 54a50d7d7fcd4847bc965ee48ab524e2. Latest consensus state: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.623769 20189 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:42:00.624109 20207 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 01:42:00.624334 20207 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 01:42:00.624790 19395 catalog_manager.cc:5495] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } health_report { overall_health: UNKNOWN } } }
I20260810 01:42:00.657737 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.654016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51712 (local address 127.16.58.66:34121)
0810 01:42:00.654121 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.654125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.654222 (+ 97us) server_negotiation.cc:407] Connection header received
0810 01:42:00.654401 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.654403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.654452 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.654529 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:00.654752 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.655249 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.656447 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.656661 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.656738 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.657026 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.657404 (+ 378us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.657507 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.657579 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.657628 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 01:42:00.657799 20202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.653932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34121 (local address 127.0.0.1:51712)
0810 01:42:00.654164 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.654179 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.654288 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.654550 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.654553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.654560 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:42:00.654676 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.654682 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.655337 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.655341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.656338 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.656349 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.656753 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.656757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.656855 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.656908 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.657484 (+ 576us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.657496 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.657571 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.657663 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260810 01:42:00.663379 19638 raft_consensus.cc:1261] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Refusing update from remote peer 54a50d7d7fcd4847bc965ee48ab524e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:00.663403 20078 raft_consensus.cc:1261] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Refusing update from remote peer 54a50d7d7fcd4847bc965ee48ab524e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:00.664027 20189 consensus_queue.cc:1035] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:00.664227 20191 consensus_queue.cc:1035] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:00.667861 20186 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: TxnStatusTablet state changed. Reason: New leader 54a50d7d7fcd4847bc965ee48ab524e2. Latest consensus state: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.667991 20186 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:00.669051 20187 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: TxnStatusTablet state changed. Reason: New leader 54a50d7d7fcd4847bc965ee48ab524e2. Latest consensus state: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.669174 20187 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:00.671308 20189 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.671415 20189 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:42:00.671797 20186 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.671916 20186 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P f74db761e7b54099823e9d3ceac2a75c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:00.672250 20214 mvcc.cc:205] Tried to move back new op lower bound from 7316791790230507520 to 7316791790073376768. Current Snapshot: MvccSnapshot[applied={T|T < 7316791790230507520}]
I20260810 01:42:00.673659 20210 mvcc.cc:205] Tried to move back new op lower bound from 7316791790230507520 to 7316791790073376768. Current Snapshot: MvccSnapshot[applied={T|T < 7316791790230507520 or (T in {7316791790230507520})}]
I20260810 01:42:00.677577 20191 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.677692 20191 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P 54a50d7d7fcd4847bc965ee48ab524e2: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:42:00.678939 20187 tablet_replica.cc:439] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } } }
I20260810 01:42:00.679056 20187 tablet_replica.cc:442] T 9402b84850ae4cc694ef25c4814a893b P fb2d2da866c046fc9d09ec6a16974f83: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:00.681308 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.676586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51724 (local address 127.16.58.66:34121)
0810 01:42:00.676696 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.676700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.676759 (+ 59us) server_negotiation.cc:407] Connection header received
0810 01:42:00.676922 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.676926 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.676976 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.677052 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:00.677361 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.678017 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.680213 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.680509 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.680607 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.680920 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.680991 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.681048 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.681136 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.681188 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:42:00.691757 20235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.688051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34121 (local address 127.16.58.66:36473)
0810 01:42:00.688325 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.688339 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.688420 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.688607 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.688609 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.688614 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:42:00.688763 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.688768 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.689728 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.689732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.690438 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.690448 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.691073 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.691076 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.691171 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.691214 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.691496 (+ 282us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.691501 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.691540 (+ 39us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.691595 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":18,"thread_start_us":88,"threads_started":1}
I20260810 01:42:00.691789 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.688130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:36473 (local address 127.16.58.66:34121)
0810 01:42:00.688229 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.688233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.688396 (+ 163us) server_negotiation.cc:407] Connection header received
0810 01:42:00.688482 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.688485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.688529 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.688604 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:00.688844 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.689639 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.690590 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.690920 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.691078 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.691340 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.691417 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.691501 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.691556 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.691637 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":40}
I20260810 01:42:00.697804 20078 raft_consensus.cc:1261] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Refusing update from remote peer 54a50d7d7fcd4847bc965ee48ab524e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:00.697851 19638 raft_consensus.cc:1261] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Refusing update from remote peer 54a50d7d7fcd4847bc965ee48ab524e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:00.698218 20191 consensus_queue.cc:1035] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:00.698369 20189 consensus_queue.cc:1035] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:00.711705 20215 mvcc.cc:205] Tried to move back new op lower bound from 7316791790375288832 to 7316791789334474752. Current Snapshot: MvccSnapshot[applied={T|T < 7316791790375288832}]
I20260810 01:42:00.740281 19395 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:00.740448 19395 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:00.742681 19395 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c: Sending DeleteTablet for 3 replicas of tablet 1dc5b578549246019b6ef064ccdce7f3
I20260810 01:42:00.743433 20050 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dc5b578549246019b6ef064ccdce7f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:00 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:42808
I20260810 01:42:00.743566 19604 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dc5b578549246019b6ef064ccdce7f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:00 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:41836
I20260810 01:42:00.744000 19395 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 01:42:00.744061 19824 tablet_service.cc:1514] Processing DeleteTablet for tablet 1dc5b578549246019b6ef064ccdce7f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:00 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:51708
W20260810 01:42:00.744432 19395 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:00.744500 20244 tablet_replica.cc:330] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: stopping tablet replica
I20260810 01:42:00.744836 20244 raft_consensus.cc:2229] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:00.745077 20244 raft_consensus.cc:2258] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:00.745244 20246 tablet_replica.cc:330] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: stopping tablet replica
I20260810 01:42:00.745421 20247 tablet_replica.cc:330] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: stopping tablet replica
I20260810 01:42:00.745500 20246 raft_consensus.cc:2229] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:00.745657 20247 raft_consensus.cc:2229] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:00.745676 20246 raft_consensus.cc:2258] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:00.745987 20247 raft_consensus.cc:2258] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:00.747159 20244 ts_tablet_manager.cc:1905] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:00.747493 20247 ts_tablet_manager.cc:1905] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:00.750174 20244 ts_tablet_manager.cc:1918] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:00.750274 20244 log.cc:1196] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/1dc5b578549246019b6ef064ccdce7f3
I20260810 01:42:00.750308 20247 ts_tablet_manager.cc:1918] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:00.750385 20247 log.cc:1196] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/1dc5b578549246019b6ef064ccdce7f3
I20260810 01:42:00.750590 20244 ts_tablet_manager.cc:1939] T 1dc5b578549246019b6ef064ccdce7f3 P f74db761e7b54099823e9d3ceac2a75c: Deleting consensus metadata
I20260810 01:42:00.750684 20247 ts_tablet_manager.cc:1939] T 1dc5b578549246019b6ef064ccdce7f3 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting consensus metadata
I20260810 01:42:00.751420 19604 tablet_service.cc:1467] Processing CreateTablet for tablet 82f96403a9b14d5095d3038b3c30a800 (DEFAULT_TABLE table=test-table [id=8da7817a8f15475ea5bce64a45c0bd7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:00.751715 19604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82f96403a9b14d5095d3038b3c30a800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:00.752059 19824 tablet_service.cc:1467] Processing CreateTablet for tablet 82f96403a9b14d5095d3038b3c30a800 (DEFAULT_TABLE table=test-table [id=8da7817a8f15475ea5bce64a45c0bd7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:00.752288 19824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82f96403a9b14d5095d3038b3c30a800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:00.754159 20181 tablet_bootstrap.cc:492] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: Bootstrap starting.
I20260810 01:42:00.754276 20180 tablet_bootstrap.cc:492] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: Bootstrap starting.
I20260810 01:42:00.754510 19377 catalog_manager.cc:4841] TS f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649): tablet 1dc5b578549246019b6ef064ccdce7f3 (table test-table [id=c50d3b8108184225a4a6b5bb03b2f126]) successfully deleted
I20260810 01:42:00.754978 20050 tablet_service.cc:1467] Processing CreateTablet for tablet 82f96403a9b14d5095d3038b3c30a800 (DEFAULT_TABLE table=test-table [id=8da7817a8f15475ea5bce64a45c0bd7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:00.755149 20181 tablet_bootstrap.cc:654] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:00.755158 20180 tablet_bootstrap.cc:654] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:00.755215 20050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82f96403a9b14d5095d3038b3c30a800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:00.756531 20180 tablet_bootstrap.cc:492] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: No bootstrap required, opened a new log
I20260810 01:42:00.756623 20180 ts_tablet_manager.cc:1397] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 01:42:00.757062 20180 raft_consensus.cc:348] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.757174 20180 raft_consensus.cc:374] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:00.757202 20180 raft_consensus.cc:729] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a50d7d7fcd4847bc965ee48ab524e2, State: Initialized, Role: FOLLOWER
I20260810 01:42:00.757205 20181 tablet_bootstrap.cc:492] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: No bootstrap required, opened a new log
I20260810 01:42:00.757285 20181 ts_tablet_manager.cc:1397] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:42:00.757308 20180 consensus_queue.cc:260] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.757568 20180 ts_tablet_manager.cc:1428] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 01:42:00.757752 20179 tablet_bootstrap.cc:492] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: Bootstrap starting.
I20260810 01:42:00.757714 20181 raft_consensus.cc:348] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.757831 20181 raft_consensus.cc:374] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:00.757862 20181 raft_consensus.cc:729] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb2d2da866c046fc9d09ec6a16974f83, State: Initialized, Role: FOLLOWER
I20260810 01:42:00.757977 20181 consensus_queue.cc:260] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.758224 20181 ts_tablet_manager.cc:1428] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:00.758607 20179 tablet_bootstrap.cc:654] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:00.760309 19376 catalog_manager.cc:4841] TS 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66:34121): tablet 1dc5b578549246019b6ef064ccdce7f3 (table test-table [id=c50d3b8108184225a4a6b5bb03b2f126]) successfully deleted
I20260810 01:42:00.760699 20246 ts_tablet_manager.cc:1905] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:00.762867 20246 ts_tablet_manager.cc:1918] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:00.762953 20246 log.cc:1196] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/1dc5b578549246019b6ef064ccdce7f3
I20260810 01:42:00.763193 20246 ts_tablet_manager.cc:1939] T 1dc5b578549246019b6ef064ccdce7f3 P fb2d2da866c046fc9d09ec6a16974f83: Deleting consensus metadata
I20260810 01:42:00.764171 19377 catalog_manager.cc:4841] TS fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321): tablet 1dc5b578549246019b6ef064ccdce7f3 (table test-table [id=c50d3b8108184225a4a6b5bb03b2f126]) successfully deleted
I20260810 01:42:00.764546 20179 tablet_bootstrap.cc:492] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: No bootstrap required, opened a new log
I20260810 01:42:00.764642 20179 ts_tablet_manager.cc:1397] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 01:42:00.765353 20179 raft_consensus.cc:348] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.765481 20179 raft_consensus.cc:374] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:00.765528 20179 raft_consensus.cc:729] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f74db761e7b54099823e9d3ceac2a75c, State: Initialized, Role: FOLLOWER
I20260810 01:42:00.765655 20179 consensus_queue.cc:260] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.765924 20179 ts_tablet_manager.cc:1428] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:00.772769 20187 raft_consensus.cc:482] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:00.772872 20187 raft_consensus.cc:504] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.773963 20187 leader_election.cc:288] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66:34121), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:00.779423 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.774603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:54665 (local address 127.16.58.67:43649)
0810 01:42:00.774705 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.774709 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.774723 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:42:00.774913 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.774917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.774969 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.775020 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:00.775482 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.776547 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.778125 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.778718 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.778820 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.778872 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.779237 (+ 365us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.779318 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 01:42:00.779927 20252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.774222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:43649 (local address 127.16.58.65:54665)
0810 01:42:00.774651 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.774668 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.774771 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.775179 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.775183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.775204 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:00.775342 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.775350 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.776709 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.776713 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.777974 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.777988 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.778990 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.778993 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.779087 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.779111 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.779673 (+ 562us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.779749 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":117,"threads_started":1}
I20260810 01:42:00.780333 20078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f96403a9b14d5095d3038b3c30a800" candidate_uuid: "fb2d2da866c046fc9d09ec6a16974f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c" is_pre_election: true
I20260810 01:42:00.780467 20078 raft_consensus.cc:2454] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb2d2da866c046fc9d09ec6a16974f83 in term 0.
I20260810 01:42:00.780795 19533 leader_election.cc:302] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f74db761e7b54099823e9d3ceac2a75c, fb2d2da866c046fc9d09ec6a16974f83; no voters:
I20260810 01:42:00.781044 20187 raft_consensus.cc:2781] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:00.781105 20187 raft_consensus.cc:482] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:00.781147 20187 raft_consensus.cc:3037] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:00.781445 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.776995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:59259 (local address 127.16.58.66:34121)
0810 01:42:00.777116 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.777120 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.777322 (+ 202us) server_negotiation.cc:407] Connection header received
0810 01:42:00.777488 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.777492 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.777544 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.777587 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:00.777956 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.778676 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.780161 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.780777 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.780863 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.780909 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.781264 (+ 355us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.781335 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:42:00.781833 20251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.774244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34121 (local address 127.16.58.65:59259)
0810 01:42:00.777245 (+ 3001us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.777259 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.777384 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.777713 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.777715 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.777732 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:00.777847 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.777852 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.778811 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.778814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.780009 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.780031 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.781035 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.781039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.781138 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.781158 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.781633 (+ 475us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.781704 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2942,"thread_start_us":65,"threads_started":1}
I20260810 01:42:00.782269 20187 raft_consensus.cc:504] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.782316 19860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f96403a9b14d5095d3038b3c30a800" candidate_uuid: "fb2d2da866c046fc9d09ec6a16974f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" is_pre_election: true
I20260810 01:42:00.782548 19860 raft_consensus.cc:2454] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb2d2da866c046fc9d09ec6a16974f83 in term 0.
I20260810 01:42:00.782612 20187 leader_election.cc:288] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [CANDIDATE]: Term 1 election: Requested vote from peers 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66:34121), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:00.782905 19860 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f96403a9b14d5095d3038b3c30a800" candidate_uuid: "fb2d2da866c046fc9d09ec6a16974f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54a50d7d7fcd4847bc965ee48ab524e2"
I20260810 01:42:00.782997 19860 raft_consensus.cc:3037] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:00.783496 20078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82f96403a9b14d5095d3038b3c30a800" candidate_uuid: "fb2d2da866c046fc9d09ec6a16974f83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c"
I20260810 01:42:00.783612 20078 raft_consensus.cc:3037] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:00.784106 19860 raft_consensus.cc:2454] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb2d2da866c046fc9d09ec6a16974f83 in term 1.
I20260810 01:42:00.784401 19532 leader_election.cc:302] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a50d7d7fcd4847bc965ee48ab524e2, fb2d2da866c046fc9d09ec6a16974f83; no voters:
I20260810 01:42:00.784585 20187 raft_consensus.cc:2781] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:00.784606 20078 raft_consensus.cc:2454] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb2d2da866c046fc9d09ec6a16974f83 in term 1.
I20260810 01:42:00.784773 20187 raft_consensus.cc:686] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 LEADER]: Becoming Leader. State: Replica: fb2d2da866c046fc9d09ec6a16974f83, State: Running, Role: LEADER
I20260810 01:42:00.785027 20187 consensus_queue.cc:237] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:00.787074 19390 catalog_manager.cc:5495] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65). New cstate: current_term: 1 leader_uuid: "fb2d2da866c046fc9d09ec6a16974f83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } health_report { overall_health: UNKNOWN } } }
I20260810 01:42:00.802083 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.798401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41850 (local address 127.16.58.65:42321)
0810 01:42:00.798519 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.798522 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.798590 (+ 68us) server_negotiation.cc:407] Connection header received
0810 01:42:00.798751 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.798753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.798799 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.798877 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:00.799103 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.799609 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.800773 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.800981 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.801060 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.801316 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.801738 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.801818 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.801910 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.801953 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:42:00.811837 20172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.808809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:54799 (local address 127.16.58.66:34121)
0810 01:42:00.808915 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.808919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.809084 (+ 165us) server_negotiation.cc:407] Connection header received
0810 01:42:00.809194 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.809198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.809242 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.809301 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:00.809524 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.810002 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.810811 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.811016 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.811107 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.811375 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.811441 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.811513 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.811616 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.811662 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 01:42:00.812454 20258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.808733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34121 (local address 127.16.58.65:54799)
0810 01:42:00.809007 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.809018 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.809116 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.809315 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.809317 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.809325 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:42:00.809429 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.809436 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.810105 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.810108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.810705 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.810713 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.811118 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.811122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.811214 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.811256 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.811526 (+ 270us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.811539 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.811593 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.811667 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":91,"threads_started":1}
I20260810 01:42:00.818276 20078 raft_consensus.cc:1261] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Refusing update from remote peer fb2d2da866c046fc9d09ec6a16974f83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:00.818701 19860 raft_consensus.cc:1261] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Refusing update from remote peer fb2d2da866c046fc9d09ec6a16974f83: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:00.819249 20253 consensus_queue.cc:1035] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:00.819423 20187 consensus_queue.cc:1035] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:00.835913 20235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.832116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42321 (local address 127.16.58.66:33937)
0810 01:42:00.832358 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:00.832374 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:00.832458 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:00.832954 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:00.832957 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:00.832965 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:42:00.833055 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.833063 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.833847 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.833850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.834606 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:00.834618 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.835206 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.835210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:00.835287 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.835319 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.835627 (+ 308us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.835633 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:42:00.835692 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 01:42:00.835768 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156}
I20260810 01:42:00.835906 20171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:00.832596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:33937 (local address 127.16.58.65:42321)
0810 01:42:00.832693 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:00.832697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:00.832709 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:00.832747 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:00.832749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:00.832792 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:00.832850 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:00.833175 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.833741 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.834742 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:00.835025 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:00.835134 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:00.835445 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:00.835523 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:00.835587 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:00.835708 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 01:42:00.835755 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 01:42:00.836616 20215 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 01:42:02.395323 19395 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:02.395475 19395 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:02.397755 19395 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c: Sending DeleteTablet for 3 replicas of tablet 82f96403a9b14d5095d3038b3c30a800
I20260810 01:42:02.398241 19604 tablet_service.cc:1514] Processing DeleteTablet for tablet 82f96403a9b14d5095d3038b3c30a800 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:02 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:41836
I20260810 01:42:02.398272 20050 tablet_service.cc:1514] Processing DeleteTablet for tablet 82f96403a9b14d5095d3038b3c30a800 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:02 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:42808
I20260810 01:42:02.398272 19824 tablet_service.cc:1514] Processing DeleteTablet for tablet 82f96403a9b14d5095d3038b3c30a800 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:02 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:51708
I20260810 01:42:02.398595 20308 tablet_replica.cc:330] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: stopping tablet replica
I20260810 01:42:02.399207 20308 raft_consensus.cc:2229] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:02.399320 20308 raft_consensus.cc:2258] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:02.399894 20308 ts_tablet_manager.cc:1905] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:02.401336 20307 tablet_replica.cc:330] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: stopping tablet replica
I20260810 01:42:02.401469 20307 raft_consensus.cc:2229] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:02.401767 20307 raft_consensus.cc:2258] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:02.402278 20307 ts_tablet_manager.cc:1905] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:02.403972 20309 tablet_replica.cc:330] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: stopping tablet replica
I20260810 01:42:02.404098 20309 raft_consensus.cc:2229] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:02.404208 20309 raft_consensus.cc:2258] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:02.404754 20309 ts_tablet_manager.cc:1905] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:02.405085 20307 ts_tablet_manager.cc:1918] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 01:42:02.405169 20307 log.cc:1196] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/82f96403a9b14d5095d3038b3c30a800
I20260810 01:42:02.405220 20308 ts_tablet_manager.cc:1918] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 01:42:02.405297 20308 log.cc:1196] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/82f96403a9b14d5095d3038b3c30a800
I20260810 01:42:02.405457 20307 ts_tablet_manager.cc:1939] T 82f96403a9b14d5095d3038b3c30a800 P fb2d2da866c046fc9d09ec6a16974f83: Deleting consensus metadata
I20260810 01:42:02.405531 20308 ts_tablet_manager.cc:1939] T 82f96403a9b14d5095d3038b3c30a800 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting consensus metadata
I20260810 01:42:02.406121 19377 catalog_manager.cc:4841] TS fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321): tablet 82f96403a9b14d5095d3038b3c30a800 (table test-table [id=8da7817a8f15475ea5bce64a45c0bd7b]) successfully deleted
I20260810 01:42:02.406220 19376 catalog_manager.cc:4841] TS 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66:34121): tablet 82f96403a9b14d5095d3038b3c30a800 (table test-table [id=8da7817a8f15475ea5bce64a45c0bd7b]) successfully deleted
I20260810 01:42:02.406929 20309 ts_tablet_manager.cc:1918] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 01:42:02.406998 20309 log.cc:1196] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/82f96403a9b14d5095d3038b3c30a800
I20260810 01:42:02.407192 20309 ts_tablet_manager.cc:1939] T 82f96403a9b14d5095d3038b3c30a800 P f74db761e7b54099823e9d3ceac2a75c: Deleting consensus metadata
I20260810 01:42:02.407716 19377 catalog_manager.cc:4841] TS f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649): tablet 82f96403a9b14d5095d3038b3c30a800 (table test-table [id=8da7817a8f15475ea5bce64a45c0bd7b]) successfully deleted
Aug 10 01:42:02 dist-test-slave-jlzn krb5kdc[19329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326122, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:42:02 dist-test-slave-jlzn krb5kdc[19329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326122, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:02.426276 20320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:02.418623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37006 (local address 127.16.58.126:43321)
0810 01:42:02.418872 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:02.418880 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:02.418926 (+ 46us) server_negotiation.cc:407] Connection header received
0810 01:42:02.419049 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:02.419051 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:02.419090 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:02.419168 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:02.419757 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:02.420335 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:02.421119 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:02.421335 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:02.421399 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:02.423509 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:02.423512 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:02.423514 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:02.423537 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:02.424990 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:02.425347 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:02.425349 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:02.425350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:02.425419 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:02.425602 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:02.425604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:02.425605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:02.425764 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:02.425861 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:02.426031 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 01:42:02.426121 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":76,"threads_started":1}
I20260810 01:42:02.428668 19395 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37006:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:02.429073 19395 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:02.433430 19604 tablet_service.cc:1467] Processing CreateTablet for tablet bac503cc76d545568afcb5e4421d1e79 (DEFAULT_TABLE table=test-table [id=340a7b6ba6824066865186dd941e6a42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:02.433447 19824 tablet_service.cc:1467] Processing CreateTablet for tablet bac503cc76d545568afcb5e4421d1e79 (DEFAULT_TABLE table=test-table [id=340a7b6ba6824066865186dd941e6a42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:02.433509 20050 tablet_service.cc:1467] Processing CreateTablet for tablet bac503cc76d545568afcb5e4421d1e79 (DEFAULT_TABLE table=test-table [id=340a7b6ba6824066865186dd941e6a42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:02.433701 19824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac503cc76d545568afcb5e4421d1e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:02.433701 19604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac503cc76d545568afcb5e4421d1e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:02.433771 20050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac503cc76d545568afcb5e4421d1e79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:02.435513 20321 tablet_bootstrap.cc:492] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: Bootstrap starting.
I20260810 01:42:02.436164 20322 tablet_bootstrap.cc:492] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: Bootstrap starting.
I20260810 01:42:02.436331 20323 tablet_bootstrap.cc:492] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: Bootstrap starting.
I20260810 01:42:02.436611 20321 tablet_bootstrap.cc:654] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:02.437012 20322 tablet_bootstrap.cc:654] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:02.437048 20323 tablet_bootstrap.cc:654] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:02.437706 20321 tablet_bootstrap.cc:492] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: No bootstrap required, opened a new log
I20260810 01:42:02.437798 20321 ts_tablet_manager.cc:1397] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:02.438086 20322 tablet_bootstrap.cc:492] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: No bootstrap required, opened a new log
I20260810 01:42:02.438086 20323 tablet_bootstrap.cc:492] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: No bootstrap required, opened a new log
I20260810 01:42:02.438166 20323 ts_tablet_manager.cc:1397] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:02.438161 20322 ts_tablet_manager.cc:1397] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:02.438118 20321 raft_consensus.cc:348] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.438215 20321 raft_consensus.cc:374] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:02.438247 20321 raft_consensus.cc:729] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f74db761e7b54099823e9d3ceac2a75c, State: Initialized, Role: FOLLOWER
I20260810 01:42:02.438360 20321 consensus_queue.cc:260] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.438527 20323 raft_consensus.cc:348] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.438527 20322 raft_consensus.cc:348] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.438627 20323 raft_consensus.cc:374] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:02.438642 20322 raft_consensus.cc:374] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:02.438659 20323 raft_consensus.cc:729] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a50d7d7fcd4847bc965ee48ab524e2, State: Initialized, Role: FOLLOWER
I20260810 01:42:02.438674 20322 raft_consensus.cc:729] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb2d2da866c046fc9d09ec6a16974f83, State: Initialized, Role: FOLLOWER
I20260810 01:42:02.438752 20321 ts_tablet_manager.cc:1428] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:02.438788 20322 consensus_queue.cc:260] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.438829 20323 consensus_queue.cc:260] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.439040 20322 ts_tablet_manager.cc:1428] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:02.439705 20323 ts_tablet_manager.cc:1428] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:02.635304 20272 raft_consensus.cc:482] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:02.635433 20272 raft_consensus.cc:504] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.635833 20272 leader_election.cc:288] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:02.636255 19636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac503cc76d545568afcb5e4421d1e79" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2d2da866c046fc9d09ec6a16974f83" is_pre_election: true
I20260810 01:42:02.636286 20077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac503cc76d545568afcb5e4421d1e79" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c" is_pre_election: true
I20260810 01:42:02.636404 19636 raft_consensus.cc:2454] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 0.
I20260810 01:42:02.636431 20077 raft_consensus.cc:2454] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 0.
I20260810 01:42:02.636758 19750 leader_election.cc:302] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a50d7d7fcd4847bc965ee48ab524e2, f74db761e7b54099823e9d3ceac2a75c; no voters:
I20260810 01:42:02.636946 20272 raft_consensus.cc:2781] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:02.637006 20272 raft_consensus.cc:482] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:02.637049 20272 raft_consensus.cc:3037] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:02.638052 20272 raft_consensus.cc:504] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.638342 20272 leader_election.cc:288] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 election: Requested vote from peers fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:02.638762 19636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac503cc76d545568afcb5e4421d1e79" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2d2da866c046fc9d09ec6a16974f83"
I20260810 01:42:02.638819 20077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac503cc76d545568afcb5e4421d1e79" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c"
I20260810 01:42:02.638895 19636 raft_consensus.cc:3037] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:02.638932 20077 raft_consensus.cc:3037] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:02.640101 20077 raft_consensus.cc:2454] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 1.
I20260810 01:42:02.640123 19636 raft_consensus.cc:2454] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 1.
I20260810 01:42:02.640372 19750 leader_election.cc:302] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a50d7d7fcd4847bc965ee48ab524e2, fb2d2da866c046fc9d09ec6a16974f83; no voters:
I20260810 01:42:02.640535 20272 raft_consensus.cc:2781] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:02.640626 20272 raft_consensus.cc:686] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 LEADER]: Becoming Leader. State: Replica: 54a50d7d7fcd4847bc965ee48ab524e2, State: Running, Role: LEADER
I20260810 01:42:02.640760 20272 consensus_queue.cc:237] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.642266 19395 catalog_manager.cc:5495] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } health_report { overall_health: UNKNOWN } } }
I20260810 01:42:02.675766 20339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:02.673156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56544 (local address 127.16.58.66:34121)
0810 01:42:02.673382 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:02.673389 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:02.673400 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:42:02.673436 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:02.673438 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:02.673474 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:02.673541 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:02.673740 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:02.674245 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:02.675002 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:02.675214 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:02.675280 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:02.675452 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:02.675514 (+ 62us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:02.675558 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:02.675614 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 01:42:02.675656 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":91,"threads_started":1}
I20260810 01:42:02.681234 20077 raft_consensus.cc:1261] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Refusing update from remote peer 54a50d7d7fcd4847bc965ee48ab524e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:02.681294 19636 raft_consensus.cc:1261] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Refusing update from remote peer 54a50d7d7fcd4847bc965ee48ab524e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:02.681571 20272 consensus_queue.cc:1035] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:02.681706 20300 consensus_queue.cc:1035] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:02.710367 19395 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:02.710496 19395 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:02.712260 19395 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c: Sending DeleteTablet for 3 replicas of tablet bac503cc76d545568afcb5e4421d1e79
I20260810 01:42:02.712723 19604 tablet_service.cc:1514] Processing DeleteTablet for tablet bac503cc76d545568afcb5e4421d1e79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:02 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:41836
I20260810 01:42:02.712795 19824 tablet_service.cc:1514] Processing DeleteTablet for tablet bac503cc76d545568afcb5e4421d1e79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:02 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:51708
I20260810 01:42:02.712919 20307 tablet_replica.cc:330] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: stopping tablet replica
I20260810 01:42:02.712904 20050 tablet_service.cc:1514] Processing DeleteTablet for tablet bac503cc76d545568afcb5e4421d1e79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:02 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:42808
I20260810 01:42:02.713013 20308 tablet_replica.cc:330] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: stopping tablet replica
I20260810 01:42:02.713030 20307 raft_consensus.cc:2229] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:02.713059 20309 tablet_replica.cc:330] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: stopping tablet replica
I20260810 01:42:02.713112 20308 raft_consensus.cc:2229] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:02.713140 20307 raft_consensus.cc:2258] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:02.713153 20309 raft_consensus.cc:2229] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:02.713253 20309 raft_consensus.cc:2258] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:02.713269 20308 raft_consensus.cc:2258] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:02.713795 20307 ts_tablet_manager.cc:1905] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:02.713804 19395 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37006:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:02.714148 19395 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:02.716322 20307 ts_tablet_manager.cc:1918] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:02.716403 20307 log.cc:1196] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/bac503cc76d545568afcb5e4421d1e79
I20260810 01:42:02.716666 20307 ts_tablet_manager.cc:1939] T bac503cc76d545568afcb5e4421d1e79 P fb2d2da866c046fc9d09ec6a16974f83: Deleting consensus metadata
I20260810 01:42:02.717355 19377 catalog_manager.cc:4841] TS fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321): tablet bac503cc76d545568afcb5e4421d1e79 (table test-table [id=340a7b6ba6824066865186dd941e6a42]) successfully deleted
I20260810 01:42:02.717742 20308 ts_tablet_manager.cc:1905] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:02.717855 20309 ts_tablet_manager.cc:1905] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:02.720155 20309 ts_tablet_manager.cc:1918] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:02.720155 20308 ts_tablet_manager.cc:1918] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:02.720237 20309 log.cc:1196] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/bac503cc76d545568afcb5e4421d1e79
I20260810 01:42:02.720237 20308 log.cc:1196] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/bac503cc76d545568afcb5e4421d1e79
I20260810 01:42:02.720481 20308 ts_tablet_manager.cc:1939] T bac503cc76d545568afcb5e4421d1e79 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting consensus metadata
I20260810 01:42:02.720481 20309 ts_tablet_manager.cc:1939] T bac503cc76d545568afcb5e4421d1e79 P f74db761e7b54099823e9d3ceac2a75c: Deleting consensus metadata
I20260810 01:42:02.721055 19376 catalog_manager.cc:4841] TS 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66:34121): tablet bac503cc76d545568afcb5e4421d1e79 (table test-table [id=340a7b6ba6824066865186dd941e6a42]) successfully deleted
I20260810 01:42:02.721347 19377 catalog_manager.cc:4841] TS f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649): tablet bac503cc76d545568afcb5e4421d1e79 (table test-table [id=340a7b6ba6824066865186dd941e6a42]) successfully deleted
I20260810 01:42:02.721935 19604 tablet_service.cc:1467] Processing CreateTablet for tablet 819947468d044a3888a12f104633e734 (DEFAULT_TABLE table=test-table [id=e0b8f75938da440fbfe7f7b248d5b5bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:02.721997 19824 tablet_service.cc:1467] Processing CreateTablet for tablet 819947468d044a3888a12f104633e734 (DEFAULT_TABLE table=test-table [id=e0b8f75938da440fbfe7f7b248d5b5bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:02.722172 19604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 819947468d044a3888a12f104633e734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:02.722229 19824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 819947468d044a3888a12f104633e734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:02.722239 20050 tablet_service.cc:1467] Processing CreateTablet for tablet 819947468d044a3888a12f104633e734 (DEFAULT_TABLE table=test-table [id=e0b8f75938da440fbfe7f7b248d5b5bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:02.722443 20050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 819947468d044a3888a12f104633e734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:02.723721 20322 tablet_bootstrap.cc:492] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83: Bootstrap starting.
I20260810 01:42:02.724371 20321 tablet_bootstrap.cc:492] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: Bootstrap starting.
I20260810 01:42:02.724428 20322 tablet_bootstrap.cc:654] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:02.725152 20321 tablet_bootstrap.cc:654] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:02.725432 20322 tablet_bootstrap.cc:492] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83: No bootstrap required, opened a new log
I20260810 01:42:02.725503 20322 ts_tablet_manager.cc:1397] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:02.725826 20323 tablet_bootstrap.cc:492] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: Bootstrap starting.
I20260810 01:42:02.725903 20322 raft_consensus.cc:348] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.725989 20322 raft_consensus.cc:374] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:02.726008 20322 raft_consensus.cc:729] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb2d2da866c046fc9d09ec6a16974f83, State: Initialized, Role: FOLLOWER
I20260810 01:42:02.726106 20322 consensus_queue.cc:260] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.726240 20321 tablet_bootstrap.cc:492] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: No bootstrap required, opened a new log
I20260810 01:42:02.726310 20321 ts_tablet_manager.cc:1397] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:02.726356 20322 ts_tablet_manager.cc:1428] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:02.726584 20323 tablet_bootstrap.cc:654] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:02.726702 20321 raft_consensus.cc:348] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.726797 20321 raft_consensus.cc:374] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:02.726827 20321 raft_consensus.cc:729] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f74db761e7b54099823e9d3ceac2a75c, State: Initialized, Role: FOLLOWER
I20260810 01:42:02.726944 20321 consensus_queue.cc:260] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.727190 20321 ts_tablet_manager.cc:1428] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:02.727519 20323 tablet_bootstrap.cc:492] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: No bootstrap required, opened a new log
I20260810 01:42:02.727605 20323 ts_tablet_manager.cc:1397] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:02.728021 20323 raft_consensus.cc:348] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.728128 20323 raft_consensus.cc:374] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:02.728163 20323 raft_consensus.cc:729] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54a50d7d7fcd4847bc965ee48ab524e2, State: Initialized, Role: FOLLOWER
I20260810 01:42:02.728274 20323 consensus_queue.cc:260] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.728518 20323 ts_tablet_manager.cc:1428] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:02.978967 20281 raft_consensus.cc:482] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:02.979091 20281 raft_consensus.cc:504] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.979436 20281 leader_election.cc:288] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:02.979876 19636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "819947468d044a3888a12f104633e734" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2d2da866c046fc9d09ec6a16974f83" is_pre_election: true
I20260810 01:42:02.979930 20077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "819947468d044a3888a12f104633e734" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c" is_pre_election: true
I20260810 01:42:02.980012 19636 raft_consensus.cc:2454] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 0.
I20260810 01:42:02.980109 20077 raft_consensus.cc:2454] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 0.
I20260810 01:42:02.980325 19750 leader_election.cc:302] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a50d7d7fcd4847bc965ee48ab524e2, fb2d2da866c046fc9d09ec6a16974f83; no voters:
I20260810 01:42:02.980525 20281 raft_consensus.cc:2781] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:02.980587 20281 raft_consensus.cc:482] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:02.980613 20281 raft_consensus.cc:3037] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:02.981640 20281 raft_consensus.cc:504] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.981942 20281 leader_election.cc:288] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 election: Requested vote from peers fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321), f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649)
I20260810 01:42:02.982272 19636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "819947468d044a3888a12f104633e734" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb2d2da866c046fc9d09ec6a16974f83"
I20260810 01:42:02.982312 20077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "819947468d044a3888a12f104633e734" candidate_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f74db761e7b54099823e9d3ceac2a75c"
I20260810 01:42:02.982388 19636 raft_consensus.cc:3037] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:02.982396 20077 raft_consensus.cc:3037] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:02.983230 20077 raft_consensus.cc:2454] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 1.
I20260810 01:42:02.983319 19636 raft_consensus.cc:2454] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54a50d7d7fcd4847bc965ee48ab524e2 in term 1.
I20260810 01:42:02.983486 19750 leader_election.cc:302] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54a50d7d7fcd4847bc965ee48ab524e2, f74db761e7b54099823e9d3ceac2a75c; no voters:
I20260810 01:42:02.983680 20281 raft_consensus.cc:2781] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:02.983772 20281 raft_consensus.cc:686] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 LEADER]: Becoming Leader. State: Replica: 54a50d7d7fcd4847bc965ee48ab524e2, State: Running, Role: LEADER
I20260810 01:42:02.983928 20281 consensus_queue.cc:237] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } }
I20260810 01:42:02.985416 19390 catalog_manager.cc:5495] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54a50d7d7fcd4847bc965ee48ab524e2" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 } health_report { overall_health: UNKNOWN } } }
I20260810 01:42:03.023488 20077 raft_consensus.cc:1261] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Refusing update from remote peer 54a50d7d7fcd4847bc965ee48ab524e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:03.023545 19636 raft_consensus.cc:1261] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Refusing update from remote peer 54a50d7d7fcd4847bc965ee48ab524e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:03.023903 20288 consensus_queue.cc:1035] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb2d2da866c046fc9d09ec6a16974f83" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:03.024044 20300 consensus_queue.cc:1035] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f74db761e7b54099823e9d3ceac2a75c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 43649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:42:03.036435 20276 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 01:42:04.581555 19390 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:04.581722 19390 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37006:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:04.583906 19390 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8744ce0f2f64cb8ad1d276519f1a54c: Sending DeleteTablet for 3 replicas of tablet 819947468d044a3888a12f104633e734
I20260810 01:42:04.584455 19819 tablet_service.cc:1514] Processing DeleteTablet for tablet 819947468d044a3888a12f104633e734 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:04 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:51708
I20260810 01:42:04.584503 19604 tablet_service.cc:1514] Processing DeleteTablet for tablet 819947468d044a3888a12f104633e734 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:04 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:41836
I20260810 01:42:04.584784 20390 tablet_replica.cc:330] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: stopping tablet replica
I20260810 01:42:04.584772 20050 tablet_service.cc:1514] Processing DeleteTablet for tablet 819947468d044a3888a12f104633e734 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:04 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:42808
I20260810 01:42:04.584811 20391 tablet_replica.cc:330] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83: stopping tablet replica
I20260810 01:42:04.584924 20391 raft_consensus.cc:2229] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:04.584954 20390 raft_consensus.cc:2229] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:04.585078 20391 raft_consensus.cc:2258] T 819947468d044a3888a12f104633e734 P fb2d2da866c046fc9d09ec6a16974f83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:04.585098 20392 tablet_replica.cc:330] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: stopping tablet replica
I20260810 01:42:04.585218 20392 raft_consensus.cc:2229] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:04.585320 20392 raft_consensus.cc:2258] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:04.585345 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 19506
I20260810 01:42:04.594913 20392 ts_tablet_manager.cc:1905] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:04.597517 20392 ts_tablet_manager.cc:1918] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 01:42:04.597585 20392 log.cc:1196] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/819947468d044a3888a12f104633e734
I20260810 01:42:04.597800 20392 ts_tablet_manager.cc:1939] T 819947468d044a3888a12f104633e734 P f74db761e7b54099823e9d3ceac2a75c: Deleting consensus metadata
I20260810 01:42:04.598402 19377 catalog_manager.cc:4841] TS f74db761e7b54099823e9d3ceac2a75c (127.16.58.67:43649): tablet 819947468d044a3888a12f104633e734 (table test-table [id=e0b8f75938da440fbfe7f7b248d5b5bb]) successfully deleted
I20260810 01:42:04.599862 20390 raft_consensus.cc:2258] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:04.600404 20390 ts_tablet_manager.cc:1905] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:04.602365 20390 ts_tablet_manager.cc:1918] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 01:42:04.602434 20390 log.cc:1196] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/819947468d044a3888a12f104633e734
I20260810 01:42:04.602674 20390 ts_tablet_manager.cc:1939] T 819947468d044a3888a12f104633e734 P 54a50d7d7fcd4847bc965ee48ab524e2: Deleting consensus metadata
I20260810 01:42:04.603251 19376 catalog_manager.cc:4841] TS 54a50d7d7fcd4847bc965ee48ab524e2 (127.16.58.66:34121): tablet 819947468d044a3888a12f104633e734 (table test-table [id=e0b8f75938da440fbfe7f7b248d5b5bb]) successfully deleted
W20260810 01:42:04.604799 19377 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:42321 (error 108)
I20260810 01:42:04.605021 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 19714
I20260810 01:42:04.607281 20397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:04.606906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42321 (local address 127.0.0.1:56700)
0810 01:42:04.607129 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:04.607199 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:42321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":73,"threads_started":1}
W20260810 01:42:04.607417 19377 catalog_manager.cc:4584] TS fb2d2da866c046fc9d09ec6a16974f83 (127.16.58.65:42321): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 819947468d044a3888a12f104633e734: Network error: Client connection negotiation failed: client connection to 127.16.58.65:42321: connect: Connection refused (error 111)
I20260810 01:42:04.615680 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 19947
I20260810 01:42:04.627588 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 19345
2026-08-10T01:42:04Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6415 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:04 dist-test-slave-jlzn krb5kdc[20402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:04 dist-test-slave-jlzn krb5kdc[20402](info): set up 2 sockets
Aug 10 01:42:04 dist-test-slave-jlzn krb5kdc[20402](info): commencing operation
krb5kdc: starting...
W20260810 01:42:05.765779 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:05 dist-test-slave-jlzn krb5kdc[20402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:42:05.882494 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:43403
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:40051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:43403
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:05.990142 20417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:05.990374 20417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:05.990414 20417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:05.994277 20417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:05.994324 20417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:05.994341 20417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:05.994357 20417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:05.994386 20417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:05.999400 20417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:40051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:43403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:43403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:06.000324 20417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:06.001235 20417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:06.009404 20424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:06.009418 20426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:06.009449 20422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:06.009549 20417 server_base.cc:1034] running on GCE node
I20260810 01:42:06.010208 20417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:06.011206 20417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:06.012364 20417 hybrid_clock.cc:648] HybridClock initialized: now 1786326126012346 us; error 28 us; skew 500 ppm
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[20402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:06.014925 20417 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:42:06.015762 20417 webserver.cc:460] Webserver started at http://127.16.58.126:41249/ using document root <none> and password file <none>
I20260810 01:42:06.016312 20417 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:06.016379 20417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:06.016561 20417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:06.018556 20417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "1e76c404bb7344f6861fbc24c8d9a17c"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "0c85e1b7e32ffbe955a140f58b98330e"
server_key_iv: "748dc947eabd4fe6399a7b0a0a01758b"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.019078 20417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "1e76c404bb7344f6861fbc24c8d9a17c"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "0c85e1b7e32ffbe955a140f58b98330e"
server_key_iv: "748dc947eabd4fe6399a7b0a0a01758b"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.022501 20417 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260810 01:42:06.024689 20436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.025772 20417 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:06.025887 20417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "1e76c404bb7344f6861fbc24c8d9a17c"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "0c85e1b7e32ffbe955a140f58b98330e"
server_key_iv: "748dc947eabd4fe6399a7b0a0a01758b"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.025978 20417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:06.055581 20417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:06.058074 20417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:06.058250 20417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:06.065054 20417 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:43403
I20260810 01:42:06.065865 20508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:43403 every 8 connection(s)
I20260810 01:42:06.066118 20417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:06.067973 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 20417
I20260810 01:42:06.068068 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:06.068312 16617 external_mini_cluster.cc:1428] Setting key 26afcb9dc905d1c37f8b6adfa1b21924
I20260810 01:42:06.068840 20509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:06.075028 20509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c: Bootstrap starting.
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[20402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:06.077390 20509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:06.078176 20509 log.cc:824] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:06.080174 20509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c: No bootstrap required, opened a new log
I20260810 01:42:06.081604 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:06.069526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36466 (local address 127.16.58.126:43403)
0810 01:42:06.069906 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:06.069924 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:06.069958 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:42:06.070575 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:06.070590 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:06.070880 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:06.071141 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:06.072074 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.073052 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.074199 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.074629 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.074735 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:06.077318 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:06.077324 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:06.077336 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:06.077363 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:06.079022 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:06.079470 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:06.079473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:06.079477 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:06.079595 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:06.079904 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:06.079906 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:06.079907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:06.080282 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:06.080433 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:06.080692 (+ 259us) server_negotiation.cc:299] Negotiation successful
0810 01:42:06.080943 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":111,"threads_started":1}
I20260810 01:42:06.083932 20509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e76c404bb7344f6861fbc24c8d9a17c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43403 } }
I20260810 01:42:06.084132 20509 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:06.084187 20509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e76c404bb7344f6861fbc24c8d9a17c, State: Initialized, Role: FOLLOWER
I20260810 01:42:06.084553 20509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e76c404bb7344f6861fbc24c8d9a17c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43403 } }
I20260810 01:42:06.084679 20509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:06.084743 20509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:06.084838 20509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:06.085609 20509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e76c404bb7344f6861fbc24c8d9a17c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43403 } }
I20260810 01:42:06.085923 20509 leader_election.cc:302] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e76c404bb7344f6861fbc24c8d9a17c; no voters:
I20260810 01:42:06.086181 20509 leader_election.cc:288] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:06.086267 20516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:06.086467 20516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [term 1 LEADER]: Becoming Leader. State: Replica: 1e76c404bb7344f6861fbc24c8d9a17c, State: Running, Role: LEADER
I20260810 01:42:06.086838 20516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e76c404bb7344f6861fbc24c8d9a17c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43403 } }
I20260810 01:42:06.087212 20509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:06.088302 20518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e76c404bb7344f6861fbc24c8d9a17c. Latest consensus state: current_term: 1 leader_uuid: "1e76c404bb7344f6861fbc24c8d9a17c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e76c404bb7344f6861fbc24c8d9a17c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43403 } } }
I20260810 01:42:06.088426 20518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:06.088773 20517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e76c404bb7344f6861fbc24c8d9a17c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e76c404bb7344f6861fbc24c8d9a17c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43403 } } }
I20260810 01:42:06.088961 20517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c [sys.catalog]: This master's current role is: LEADER
W20260810 01:42:06.091607 20541 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:42:06.091677 20541 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:42:06.091763 20532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:06.092711 20532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:06.097751 20532 catalog_manager.cc:1347] Generated new cluster ID: 703341361a764df58e77cffd66cf154c
I20260810 01:42:06.097818 20532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:06.105240 20532 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:06.106341 20532 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:06.118896 20532 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e76c404bb7344f6861fbc24c8d9a17c: Generated new TSK 0
I20260810 01:42:06.119481 20532 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:42:06.152555 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43403
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:40051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:06.288071 20547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:06.288338 20547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:06.288399 20547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:06.292418 20547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:06.292476 20547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:06.292552 20547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:06.297629 20547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:40051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:06.298560 20547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:06.299477 20547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:06.308542 20553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:06.308625 20547 server_base.cc:1034] running on GCE node
W20260810 01:42:06.308578 20554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:06.308550 20558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:06.309139 20547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:06.309815 20547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:06.310987 20547 hybrid_clock.cc:648] HybridClock initialized: now 1786326126310963 us; error 36 us; skew 500 ppm
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[20402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:06.313669 20547 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:42:06.314435 20547 webserver.cc:460] Webserver started at http://127.16.58.65:37907/ using document root <none> and password file <none>
I20260810 01:42:06.314921 20547 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:06.314976 20547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:06.315138 20547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:06.317044 20547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "b1f5a6244fe145e3b54d44b9bc470d81"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "9697aa884c1de2e2b3f7e3a9e44b0d02"
server_key_iv: "cce76f2bd73c6f4157217d644353418b"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.317541 20547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "b1f5a6244fe145e3b54d44b9bc470d81"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "9697aa884c1de2e2b3f7e3a9e44b0d02"
server_key_iv: "cce76f2bd73c6f4157217d644353418b"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.320953 20547 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:06.323105 20568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.324240 20547 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:06.324368 20547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "b1f5a6244fe145e3b54d44b9bc470d81"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "9697aa884c1de2e2b3f7e3a9e44b0d02"
server_key_iv: "cce76f2bd73c6f4157217d644353418b"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.324462 20547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:06.333243 20547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:06.336139 20547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:06.336304 20547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:06.336833 20547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:06.337587 20547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:06.337643 20547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.337697 20547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:06.337720 20547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.345808 20547 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:33705
I20260810 01:42:06.345839 20747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:33705 every 8 connection(s)
I20260810 01:42:06.346580 20547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:06.348721 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 20547
I20260810 01:42:06.348816 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:06.349043 16617 external_mini_cluster.cc:1428] Setting key bcbd80a26637c8c899ddc983ce612728
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[20402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:42:06.359493 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:06.348190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:46355 (local address 127.16.58.126:43403)
0810 01:42:06.348316 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:06.348320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:06.349362 (+ 1042us) server_negotiation.cc:407] Connection header received
0810 01:42:06.350247 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:06.350250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:06.350305 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:06.350381 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:06.351475 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.352140 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.353297 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.353605 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.353721 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:06.356172 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:06.356176 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:06.356178 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:06.356203 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:06.357552 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:06.358031 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:06.358035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:06.358037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:06.358115 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:06.358419 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:06.358423 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:06.358425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:06.358642 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:06.358738 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:06.359200 (+ 462us) server_negotiation.cc:299] Negotiation successful
0810 01:42:06.359329 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:06.360231 20750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:06.348529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43403 (local address 127.16.58.65:46355)
0810 01:42:06.349216 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:06.349267 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:06.350044 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:06.350557 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:06.350563 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:06.350887 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:06.351330 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:06.351342 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.352258 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.352261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:06.353168 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:06.353178 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.353747 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.353750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:06.353882 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:06.354384 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:06.354399 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:06.355969 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:06.357667 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:06.357673 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:06.357686 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:06.357934 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:06.358201 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:06.358204 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:06.358206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:06.358334 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:06.358747 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:06.358753 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:06.358975 (+ 222us) client_negotiation.cc:769] Sending connection context
0810 01:42:06.359141 (+ 166us) client_negotiation.cc:240] Negotiation successful
0810 01:42:06.359433 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":107,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
I20260810 01:42:06.361322 20748 heartbeater.cc:347] Connected to a master server at 127.16.58.126:43403
I20260810 01:42:06.361545 20748 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:06.362099 20748 heartbeater.cc:511] Master 127.16.58.126:43403 requested a full tablet report, sending...
I20260810 01:42:06.363629 20459 ts_manager.cc:194] Registered new tserver with Master: b1f5a6244fe145e3b54d44b9bc470d81 (127.16.58.65:33705)
I20260810 01:42:06.364722 20459 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:46355
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:42:06.374522 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43403
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:40051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:06.483966 20754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:06.484189 20754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:06.484228 20754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:06.488150 20754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:06.488209 20754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:06.488278 20754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:06.493364 20754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:40051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:06.494269 20754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:06.495178 20754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:06.504179 20767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:06.504170 20764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:06.504225 20754 server_base.cc:1034] running on GCE node
W20260810 01:42:06.504169 20765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:06.504787 20754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:06.505378 20754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:06.506529 20754 hybrid_clock.cc:648] HybridClock initialized: now 1786326126506514 us; error 25 us; skew 500 ppm
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[20402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:06.509095 20754 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:42:06.509930 20754 webserver.cc:460] Webserver started at http://127.16.58.66:34079/ using document root <none> and password file <none>
I20260810 01:42:06.510435 20754 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:06.510495 20754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:06.510679 20754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:06.512660 20754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "1b279e4571e141d5bc8e880d6acef782"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "98cbd3d7ca5299d1fd8d1b169b999350"
server_key_iv: "fba314399ec108c71e296cb6b1578891"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.513190 20754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "1b279e4571e141d5bc8e880d6acef782"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "98cbd3d7ca5299d1fd8d1b169b999350"
server_key_iv: "fba314399ec108c71e296cb6b1578891"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.516662 20754 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:06.518844 20777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.519958 20754 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:06.520071 20754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "1b279e4571e141d5bc8e880d6acef782"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "98cbd3d7ca5299d1fd8d1b169b999350"
server_key_iv: "fba314399ec108c71e296cb6b1578891"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.520170 20754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:06.531867 20754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:06.534379 20754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:06.534543 20754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:06.535075 20754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:06.535897 20754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:06.535945 20754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.535997 20754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:06.536028 20754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.544906 20754 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:38367
I20260810 01:42:06.544934 20941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:38367 every 8 connection(s)
I20260810 01:42:06.545776 20754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:06.550216 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 20754
I20260810 01:42:06.550326 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:06.550621 16617 external_mini_cluster.cc:1428] Setting key b2e1f9fde078b3fbd7a7313cb1b3b97a
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[20402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:06.559185 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:06.547413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:52495 (local address 127.16.58.126:43403)
0810 01:42:06.547577 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:06.547582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:06.548571 (+ 989us) server_negotiation.cc:407] Connection header received
0810 01:42:06.549384 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:06.549387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:06.549433 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:06.549493 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:06.550778 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.551384 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.552854 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.553071 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.553189 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:06.555683 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:06.555687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:06.555689 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:06.555718 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:06.557279 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:06.557751 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:06.557755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:06.557757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:06.557850 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:06.558129 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:06.558132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:06.558134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:06.558365 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:06.558473 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:06.558898 (+ 425us) server_negotiation.cc:299] Negotiation successful
0810 01:42:06.559022 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 01:42:06.559865 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:06.547778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43403 (local address 127.16.58.66:52495)
0810 01:42:06.548437 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:06.548476 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:06.549206 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:06.549645 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:06.549651 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:06.549986 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:06.550624 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:06.550657 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.551513 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.551516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:06.552738 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:06.552750 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.553232 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.553236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:06.553419 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:06.554012 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:06.554032 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:06.555504 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:06.557391 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:06.557396 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:06.557407 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:06.557659 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:06.557932 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:06.557934 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:06.557935 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:06.558049 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:06.558454 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:06.558458 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:06.558676 (+ 218us) client_negotiation.cc:769] Sending connection context
0810 01:42:06.558822 (+ 146us) client_negotiation.cc:240] Negotiation successful
0810 01:42:06.559047 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":111,"threads_started":1}
I20260810 01:42:06.560927 20943 heartbeater.cc:347] Connected to a master server at 127.16.58.126:43403
I20260810 01:42:06.561147 20943 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:42:06.561605 20943 heartbeater.cc:511] Master 127.16.58.126:43403 requested a full tablet report, sending...
I20260810 01:42:06.562621 20459 ts_manager.cc:194] Registered new tserver with Master: 1b279e4571e141d5bc8e880d6acef782 (127.16.58.66:38367)
I20260810 01:42:06.563169 20459 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:52495
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:42:06.578163 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43403
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:40051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:06.686697 20954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:06.686916 20954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:06.686956 20954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:06.690928 20954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:06.690979 20954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:06.691037 20954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:06.695999 20954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:40051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:06.696837 20954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:06.697702 20954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:06.706699 20966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:06.706705 20960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:06.706701 20961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:06.706993 20954 server_base.cc:1034] running on GCE node
I20260810 01:42:06.707387 20954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:06.708000 20954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:06.709182 20954 hybrid_clock.cc:648] HybridClock initialized: now 1786326126709156 us; error 38 us; skew 500 ppm
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[20402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:06.711660 20954 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:42:06.712493 20954 webserver.cc:460] Webserver started at http://127.16.58.67:37623/ using document root <none> and password file <none>
I20260810 01:42:06.713028 20954 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:06.713092 20954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:06.713285 20954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:06.715160 20954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "b9a8b8fe3cdb4cf8b1f92d8b31f605d8"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "24d4e335bf3a8bbf157b948a6e028b1b"
server_key_iv: "6acc79a11f30b81917c314b26250d399"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.715677 20954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "b9a8b8fe3cdb4cf8b1f92d8b31f605d8"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "24d4e335bf3a8bbf157b948a6e028b1b"
server_key_iv: "6acc79a11f30b81917c314b26250d399"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.719076 20954 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20260810 01:42:06.721323 20976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.722388 20954 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:06.722497 20954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "b9a8b8fe3cdb4cf8b1f92d8b31f605d8"
format_stamp: "Formatted at 2026-08-10 01:42:06 on dist-test-slave-jlzn"
server_key: "24d4e335bf3a8bbf157b948a6e028b1b"
server_key_iv: "6acc79a11f30b81917c314b26250d399"
server_key_version: "encryptionkey@0"
I20260810 01:42:06.722589 20954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:06.759295 20954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:06.761888 20954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:06.762058 20954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:06.762617 20954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:06.763410 20954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:06.763466 20954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.763531 20954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:06.763562 20954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:06.771754 20954 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:42883
I20260810 01:42:06.771785 21136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:42883 every 8 connection(s)
I20260810 01:42:06.772599 20954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:06.773694 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 20954
I20260810 01:42:06.773797 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:06.774067 16617 external_mini_cluster.cc:1428] Setting key 0efec91f9510a1953f51bea04428a131
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[20402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326126, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:06.784682 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:06.774330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:53905 (local address 127.16.58.126:43403)
0810 01:42:06.774468 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:06.774473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:06.775576 (+ 1103us) server_negotiation.cc:407] Connection header received
0810 01:42:06.776468 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:06.776471 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:06.776515 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:06.776571 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:06.777616 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.778124 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.779296 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.779512 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.779588 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:06.781789 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:06.781792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:06.781794 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:06.781819 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:06.783067 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:06.783491 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:06.783494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:06.783495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:06.783564 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:06.783843 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:06.783846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:06.783848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:06.784013 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:06.784086 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:06.784476 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 01:42:06.784566 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:42:06.785455 21139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:06.774718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43403 (local address 127.16.58.67:53905)
0810 01:42:06.775431 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:06.775481 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:06.776280 (+ 799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:06.776724 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:06.776730 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:06.777063 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:06.777502 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:06.777516 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.778226 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.778228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:06.779194 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:06.779205 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:06.779622 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:06.779625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:06.779756 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:06.780264 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:06.780280 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:06.781629 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:06.783165 (+ 1536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:06.783169 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:06.783180 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:06.783418 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:06.783626 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:06.783628 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:06.783629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:06.783750 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:06.784089 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:06.784094 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:06.784303 (+ 209us) client_negotiation.cc:769] Sending connection context
0810 01:42:06.784445 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 01:42:06.784698 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":133,"threads_started":1}
I20260810 01:42:06.786469 21137 heartbeater.cc:347] Connected to a master server at 127.16.58.126:43403
I20260810 01:42:06.786708 21137 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:06.787258 21137 heartbeater.cc:511] Master 127.16.58.126:43403 requested a full tablet report, sending...
I20260810 01:42:06.788312 20459 ts_manager.cc:194] Registered new tserver with Master: b9a8b8fe3cdb4cf8b1f92d8b31f605d8 (127.16.58.67:42883)
I20260810 01:42:06.788904 20459 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:53905
I20260810 01:42:06.799237 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 01:42:06.812568 20514 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:06.811231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36472 (local address 127.16.58.126:43403)
0810 01:42:06.811372 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:06.811376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:06.811512 (+ 136us) server_negotiation.cc:407] Connection header received
0810 01:42:06.811631 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:06.811633 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:06.811674 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:06.811737 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:06.812426 (+ 689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36472: BlockingRecv error: recv got EOF from 127.0.0.1:36472 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:42:06.813751 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 20547
I20260810 01:42:06.829478 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 20754
I20260810 01:42:06.842172 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 20954
I20260810 01:42:06.869781 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 20417
2026-08-10T01:42:06Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2240 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[21152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[21152](info): set up 2 sockets
Aug 10 01:42:06 dist-test-slave-jlzn krb5kdc[21152](info): commencing operation
krb5kdc: starting...
W20260810 01:42:07.988066 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:08 dist-test-slave-jlzn krb5kdc[21152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:42:08.102309 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:42531
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:46027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:42531
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:08.208981 21173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:08.209223 21173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:08.209259 21173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:08.213136 21173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:08.213177 21173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:08.213194 21173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:08.213212 21173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:08.213236 21173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:08.218071 21173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:46027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:42531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:42531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:08.218906 21173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:08.219763 21173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:08.227432 21182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:08.227438 21185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:08.227449 21181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:08.227701 21173 server_base.cc:1034] running on GCE node
I20260810 01:42:08.228299 21173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:08.229233 21173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:08.230384 21173 hybrid_clock.cc:648] HybridClock initialized: now 1786326128230365 us; error 30 us; skew 500 ppm
Aug 10 01:42:08 dist-test-slave-jlzn krb5kdc[21152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326128, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:08.232903 21173 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:42:08.233686 21173 webserver.cc:460] Webserver started at http://127.16.58.126:32913/ using document root <none> and password file <none>
I20260810 01:42:08.234180 21173 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:08.234247 21173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:08.234448 21173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:08.236392 21173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "ebf73766443f4d31abcbf6da2ec010ef"
format_stamp: "Formatted at 2026-08-10 01:42:08 on dist-test-slave-jlzn"
server_key: "701ffdbff5c0628c12b7855a391bd7f5"
server_key_iv: "8ef032702c1645b7ac1e9716c5d1a5d3"
server_key_version: "encryptionkey@0"
I20260810 01:42:08.236950 21173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "ebf73766443f4d31abcbf6da2ec010ef"
format_stamp: "Formatted at 2026-08-10 01:42:08 on dist-test-slave-jlzn"
server_key: "701ffdbff5c0628c12b7855a391bd7f5"
server_key_iv: "8ef032702c1645b7ac1e9716c5d1a5d3"
server_key_version: "encryptionkey@0"
I20260810 01:42:08.240363 21173 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:08.242451 21195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:08.243534 21173 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:08.243661 21173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "ebf73766443f4d31abcbf6da2ec010ef"
format_stamp: "Formatted at 2026-08-10 01:42:08 on dist-test-slave-jlzn"
server_key: "701ffdbff5c0628c12b7855a391bd7f5"
server_key_iv: "8ef032702c1645b7ac1e9716c5d1a5d3"
server_key_version: "encryptionkey@0"
I20260810 01:42:08.243748 21173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:08.264431 21173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:08.267216 21173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:08.267374 21173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:08.273828 21173 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:42531
I20260810 01:42:08.274161 21262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:42531 every 8 connection(s)
I20260810 01:42:08.274699 21173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:08.277329 21263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:08.277493 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 21173
I20260810 01:42:08.277626 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:08.277940 16617 external_mini_cluster.cc:1428] Setting key 5a35d795dfea48a6389daf701331fddf
I20260810 01:42:08.284127 21263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef: Bootstrap starting.
I20260810 01:42:08.286459 21263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef: Neither blocks nor log segments found. Creating new log.
Aug 10 01:42:08 dist-test-slave-jlzn krb5kdc[21152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:08.287194 21263 log.cc:824] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:08.289160 21263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef: No bootstrap required, opened a new log
I20260810 01:42:08.291289 21271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:08.279120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53484 (local address 127.16.58.126:42531)
0810 01:42:08.279527 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:08.279546 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:08.279665 (+ 119us) server_negotiation.cc:407] Connection header received
0810 01:42:08.280507 (+ 842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:08.280539 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:08.280935 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:08.281293 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:08.281905 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:08.283340 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:08.284172 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:08.284824 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:08.284973 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:08.287145 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:08.287151 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:08.287166 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:08.287197 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:08.288768 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:08.289241 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:08.289247 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:08.289253 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:08.289362 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:08.289627 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:08.289629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:08.289630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:08.289968 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:08.290111 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:08.290371 (+ 260us) server_negotiation.cc:299] Negotiation successful
0810 01:42:08.290630 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":105,"threads_started":1}
I20260810 01:42:08.293001 21263 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf73766443f4d31abcbf6da2ec010ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42531 } }
I20260810 01:42:08.293237 21263 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:08.293300 21263 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebf73766443f4d31abcbf6da2ec010ef, State: Initialized, Role: FOLLOWER
I20260810 01:42:08.293725 21263 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf73766443f4d31abcbf6da2ec010ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42531 } }
I20260810 01:42:08.293867 21263 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:08.293928 21263 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:08.293998 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:42:08.294019 21263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:08.294792 21263 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf73766443f4d31abcbf6da2ec010ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42531 } }
I20260810 01:42:08.295087 21263 leader_election.cc:302] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebf73766443f4d31abcbf6da2ec010ef; no voters:
I20260810 01:42:08.295356 21263 leader_election.cc:288] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:08.295490 21273 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:08.295696 21273 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [term 1 LEADER]: Becoming Leader. State: Replica: ebf73766443f4d31abcbf6da2ec010ef, State: Running, Role: LEADER
I20260810 01:42:08.296008 21273 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf73766443f4d31abcbf6da2ec010ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42531 } }
I20260810 01:42:08.296586 21263 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:08.297096 21275 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebf73766443f4d31abcbf6da2ec010ef. Latest consensus state: current_term: 1 leader_uuid: "ebf73766443f4d31abcbf6da2ec010ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf73766443f4d31abcbf6da2ec010ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42531 } } }
I20260810 01:42:08.297215 21275 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:08.297845 21274 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebf73766443f4d31abcbf6da2ec010ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebf73766443f4d31abcbf6da2ec010ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42531 } } }
I20260810 01:42:08.297955 21274 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:08.300467 21282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:08.303368 21282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:08.308844 21282 catalog_manager.cc:1347] Generated new cluster ID: aad054bcb30649089656989d57a5ed19
I20260810 01:42:08.308902 21282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:08.313521 21271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:08.308039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53492 (local address 127.16.58.126:42531)
0810 01:42:08.308142 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:08.308146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:08.308389 (+ 243us) server_negotiation.cc:407] Connection header received
0810 01:42:08.308576 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:08.308579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:08.308625 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:08.308674 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:08.309372 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:08.310162 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:08.311330 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:08.311687 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:08.311769 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:08.312624 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:08.312627 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:08.312636 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:08.313099 (+ 463us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:08.313128 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:08.313146 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:08.313222 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:08.313335 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 01:42:08.313389 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:42:08.318526 21282 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:08.319332 21282 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:08.323040 21282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebf73766443f4d31abcbf6da2ec010ef: Generated new TSK 0
I20260810 01:42:08.323745 21282 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:42:08.328562 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 21173
2026-08-10T01:42:08Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1459 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:08 dist-test-slave-jlzn krb5kdc[21319](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:08 dist-test-slave-jlzn krb5kdc[21319](info): set up 2 sockets
Aug 10 01:42:08 dist-test-slave-jlzn krb5kdc[21319](info): commencing operation
krb5kdc: starting...
W20260810 01:42:09.454213 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:09 dist-test-slave-jlzn krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:42:09.567523 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39593
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:39593
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:09.673499 21339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:09.673723 21339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:09.673777 21339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:09.677649 21339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:09.677695 21339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:09.677721 21339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:09.677742 21339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:09.677770 21339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:09.682700 21339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:39593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:09.683549 21339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:09.684444 21339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:09.692047 21348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:09.692047 21347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:09.692091 21339 server_base.cc:1034] running on GCE node
W20260810 01:42:09.692040 21352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:09.692811 21339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:09.693739 21339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:09.694881 21339 hybrid_clock.cc:648] HybridClock initialized: now 1786326129694863 us; error 31 us; skew 500 ppm
Aug 10 01:42:09 dist-test-slave-jlzn krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326129, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:09.699786 21339 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:42:09.700572 21339 webserver.cc:460] Webserver started at http://127.16.58.126:45783/ using document root <none> and password file <none>
I20260810 01:42:09.701028 21339 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:09.701083 21339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:09.701253 21339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:09.703035 21339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "f95606e461964002a38c3fc7eeca33d6"
format_stamp: "Formatted at 2026-08-10 01:42:09 on dist-test-slave-jlzn"
server_key: "bfde35b10dac43acf2d39c50d80d23ce"
server_key_iv: "b8ff16cd5cb9cb4d1ca5d9829c4f7578"
server_key_version: "encryptionkey@0"
I20260810 01:42:09.703528 21339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "f95606e461964002a38c3fc7eeca33d6"
format_stamp: "Formatted at 2026-08-10 01:42:09 on dist-test-slave-jlzn"
server_key: "bfde35b10dac43acf2d39c50d80d23ce"
server_key_iv: "b8ff16cd5cb9cb4d1ca5d9829c4f7578"
server_key_version: "encryptionkey@0"
I20260810 01:42:09.706863 21339 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20260810 01:42:09.709048 21362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:09.710115 21339 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:09.710233 21339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "f95606e461964002a38c3fc7eeca33d6"
format_stamp: "Formatted at 2026-08-10 01:42:09 on dist-test-slave-jlzn"
server_key: "bfde35b10dac43acf2d39c50d80d23ce"
server_key_iv: "b8ff16cd5cb9cb4d1ca5d9829c4f7578"
server_key_version: "encryptionkey@0"
I20260810 01:42:09.710311 21339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:09.730612 21339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:09.732975 21339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:09.733109 21339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:09.739398 21339 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:39593
I20260810 01:42:09.739638 21436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:39593 every 8 connection(s)
I20260810 01:42:09.740257 21339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:09.742729 21437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:09.742872 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 21339
I20260810 01:42:09.742982 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:09.743271 16617 external_mini_cluster.cc:1428] Setting key 95f41f9b27866986d8f9b67af22709e4
I20260810 01:42:09.748546 21437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6: Bootstrap starting.
I20260810 01:42:09.750660 21437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6: Neither blocks nor log segments found. Creating new log.
Aug 10 01:42:09 dist-test-slave-jlzn krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:09.751458 21437 log.cc:824] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:09.753379 21437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6: No bootstrap required, opened a new log
I20260810 01:42:09.756546 21442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:09.744560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58694 (local address 127.16.58.126:39593)
0810 01:42:09.744962 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:09.744976 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:09.745008 (+ 32us) server_negotiation.cc:407] Connection header received
0810 01:42:09.745733 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:09.745750 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:09.746031 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:09.746317 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:09.747097 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:09.748104 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:09.748977 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:09.749426 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:09.749567 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:09.752223 (+ 2656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:09.752228 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:09.752239 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:09.752265 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:09.753797 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:09.754304 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:09.754309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:09.754313 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:09.754433 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:09.754748 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:09.754751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:09.754752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:09.755124 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:09.755281 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:09.755581 (+ 300us) server_negotiation.cc:299] Negotiation successful
0810 01:42:09.755877 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":135,"threads_started":1}
I20260810 01:42:09.757040 21437 raft_consensus.cc:348] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f95606e461964002a38c3fc7eeca33d6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39593 } }
I20260810 01:42:09.757237 21437 raft_consensus.cc:374] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:09.757287 21437 raft_consensus.cc:729] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f95606e461964002a38c3fc7eeca33d6, State: Initialized, Role: FOLLOWER
I20260810 01:42:09.758528 21437 consensus_queue.cc:260] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f95606e461964002a38c3fc7eeca33d6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39593 } }
I20260810 01:42:09.758665 21437 raft_consensus.cc:388] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:09.758733 21437 raft_consensus.cc:482] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:09.758822 21437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:09.759600 21437 raft_consensus.cc:504] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f95606e461964002a38c3fc7eeca33d6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39593 } }
I20260810 01:42:09.759938 21437 leader_election.cc:302] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f95606e461964002a38c3fc7eeca33d6; no voters:
I20260810 01:42:09.760208 21437 leader_election.cc:288] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:09.760293 21446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:09.760505 21446 raft_consensus.cc:686] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [term 1 LEADER]: Becoming Leader. State: Replica: f95606e461964002a38c3fc7eeca33d6, State: Running, Role: LEADER
I20260810 01:42:09.760847 21446 consensus_queue.cc:237] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f95606e461964002a38c3fc7eeca33d6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39593 } }
I20260810 01:42:09.761261 21437 sys_catalog.cc:564] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:09.762445 21452 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f95606e461964002a38c3fc7eeca33d6. Latest consensus state: current_term: 1 leader_uuid: "f95606e461964002a38c3fc7eeca33d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f95606e461964002a38c3fc7eeca33d6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39593 } } }
I20260810 01:42:09.762482 21448 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f95606e461964002a38c3fc7eeca33d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f95606e461964002a38c3fc7eeca33d6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39593 } } }
I20260810 01:42:09.762566 21452 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:09.762595 21448 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:09.762952 21462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:09.765513 21462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:09.770641 21462 catalog_manager.cc:1347] Generated new cluster ID: b1f6fe4c9c7e4ee0978b9ff215915f92
I20260810 01:42:09.770720 21462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:09.777971 21462 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:09.779107 21462 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:09.784299 21462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f95606e461964002a38c3fc7eeca33d6: Generated new TSK 0
I20260810 01:42:09.784963 21462 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:42:09.816510 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39593
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:09.923913 21475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:09.924145 21475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:09.924193 21475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:09.928054 21475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:09.928100 21475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:09.928177 21475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:09.933171 21475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:09.934039 21475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:09.934942 21475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:09.943775 21475 server_base.cc:1034] running on GCE node
W20260810 01:42:09.943730 21487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:09.943708 21481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:09.943730 21482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:09.944356 21475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:09.944936 21475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:09.946086 21475 hybrid_clock.cc:648] HybridClock initialized: now 1786326129946070 us; error 27 us; skew 500 ppm
Aug 10 01:42:09 dist-test-slave-jlzn krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326129, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:09.948704 21475 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:42:09.949453 21475 webserver.cc:460] Webserver started at http://127.16.58.65:34381/ using document root <none> and password file <none>
I20260810 01:42:09.949927 21475 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:09.949981 21475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:09.950142 21475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:09.952072 21475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "ab49c320d50642ce869150b9c961ebe4"
format_stamp: "Formatted at 2026-08-10 01:42:09 on dist-test-slave-jlzn"
server_key: "cadb83bda56d2097e425eb9257d0f4a4"
server_key_iv: "542a570edf1741dda568e295d2ea18e5"
server_key_version: "encryptionkey@0"
I20260810 01:42:09.952596 21475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "ab49c320d50642ce869150b9c961ebe4"
format_stamp: "Formatted at 2026-08-10 01:42:09 on dist-test-slave-jlzn"
server_key: "cadb83bda56d2097e425eb9257d0f4a4"
server_key_iv: "542a570edf1741dda568e295d2ea18e5"
server_key_version: "encryptionkey@0"
I20260810 01:42:09.956013 21475 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260810 01:42:09.958205 21497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:09.959298 21475 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:09.959393 21475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "ab49c320d50642ce869150b9c961ebe4"
format_stamp: "Formatted at 2026-08-10 01:42:09 on dist-test-slave-jlzn"
server_key: "cadb83bda56d2097e425eb9257d0f4a4"
server_key_iv: "542a570edf1741dda568e295d2ea18e5"
server_key_version: "encryptionkey@0"
I20260810 01:42:09.959467 21475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:09.986790 21475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:09.989655 21475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:09.989794 21475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:09.990274 21475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:09.991007 21475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:09.991053 21475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:09.991091 21475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:09.991111 21475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:09.999347 21475 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:43527
I20260810 01:42:09.999372 21669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:43527 every 8 connection(s)
I20260810 01:42:10.000183 21475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:10.002321 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 21475
I20260810 01:42:10.002441 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:10.002748 16617 external_mini_cluster.cc:1428] Setting key e0f1a9978f470abdce0fc1b87dfade8e
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326129, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:42:10.013221 21442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:10.001767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:35789 (local address 127.16.58.126:39593)
0810 01:42:10.001884 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:10.001887 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:10.002725 (+ 838us) server_negotiation.cc:407] Connection header received
0810 01:42:10.004303 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:10.004307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:10.004360 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:10.004444 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:10.005475 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.006199 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.007303 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.007529 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.007614 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:10.009941 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:10.009944 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:10.009946 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:10.009969 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:10.011278 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:10.011757 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:10.011760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:10.011761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:10.011875 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:10.012190 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:10.012194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:10.012195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:10.012368 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:10.012454 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:10.012928 (+ 474us) server_negotiation.cc:299] Negotiation successful
0810 01:42:10.013056 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:42:10.013962 21673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:10.002088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39593 (local address 127.16.58.65:35789)
0810 01:42:10.002594 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:10.002634 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:10.004078 (+ 1444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:10.004575 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:10.004581 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:10.004899 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:10.005334 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:10.005347 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.006318 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.006322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:10.007183 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:10.007193 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.007662 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.007667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:10.007856 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:10.008394 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:10.008414 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:10.009789 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:10.011388 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:10.011393 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:10.011406 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:10.011665 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:10.011959 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:10.011962 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:10.011964 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:10.012096 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:10.012467 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:10.012474 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:10.012690 (+ 216us) client_negotiation.cc:769] Sending connection context
0810 01:42:10.012862 (+ 172us) client_negotiation.cc:240] Negotiation successful
0810 01:42:10.013206 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":142,"threads_started":1}
I20260810 01:42:10.014974 21670 heartbeater.cc:347] Connected to a master server at 127.16.58.126:39593
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
I20260810 01:42:10.015251 21670 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:10.015761 21670 heartbeater.cc:511] Master 127.16.58.126:39593 requested a full tablet report, sending...
I20260810 01:42:10.017148 21385 ts_manager.cc:194] Registered new tserver with Master: ab49c320d50642ce869150b9c961ebe4 (127.16.58.65:43527)
I20260810 01:42:10.018514 21385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:35789
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:42:10.028692 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39593
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:10.135407 21676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:10.135722 21676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:10.135785 21676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:10.139757 21676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:10.139835 21676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:10.139904 21676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:10.144922 21676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:10.145802 21676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:10.146695 21676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:10.155686 21686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:10.155681 21683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:10.155681 21684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:10.155915 21676 server_base.cc:1034] running on GCE node
I20260810 01:42:10.156343 21676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:10.156924 21676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:10.158069 21676 hybrid_clock.cc:648] HybridClock initialized: now 1786326130158049 us; error 31 us; skew 500 ppm
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:10.160629 21676 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:42:10.161433 21676 webserver.cc:460] Webserver started at http://127.16.58.66:35177/ using document root <none> and password file <none>
I20260810 01:42:10.161949 21676 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:10.162009 21676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:10.162235 21676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:10.164391 21676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "1167f8eb4d8248fdaa56aec484c9119f"
format_stamp: "Formatted at 2026-08-10 01:42:10 on dist-test-slave-jlzn"
server_key: "53578958bad1e95392210b46132082a1"
server_key_iv: "5e4f4841ec042b6fcfa2d0ffd78b73b1"
server_key_version: "encryptionkey@0"
I20260810 01:42:10.164901 21676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "1167f8eb4d8248fdaa56aec484c9119f"
format_stamp: "Formatted at 2026-08-10 01:42:10 on dist-test-slave-jlzn"
server_key: "53578958bad1e95392210b46132082a1"
server_key_iv: "5e4f4841ec042b6fcfa2d0ffd78b73b1"
server_key_version: "encryptionkey@0"
I20260810 01:42:10.168337 21676 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:42:10.170619 21697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:10.171751 21676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:10.171886 21676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "1167f8eb4d8248fdaa56aec484c9119f"
format_stamp: "Formatted at 2026-08-10 01:42:10 on dist-test-slave-jlzn"
server_key: "53578958bad1e95392210b46132082a1"
server_key_iv: "5e4f4841ec042b6fcfa2d0ffd78b73b1"
server_key_version: "encryptionkey@0"
I20260810 01:42:10.171980 21676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:10.189700 21676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:10.192507 21676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:10.192662 21676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:10.193174 21676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:10.193913 21676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:10.193959 21676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:10.194002 21676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:10.194031 21676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:10.201959 21676 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:44575
I20260810 01:42:10.202016 21877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:44575 every 8 connection(s)
I20260810 01:42:10.202754 21676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:10.203864 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 21676
I20260810 01:42:10.203977 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:10.204257 16617 external_mini_cluster.cc:1428] Setting key 797da37290fbc379b80b216c390aa88b
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:42:10.216784 21442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:10.204502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:39301 (local address 127.16.58.126:39593)
0810 01:42:10.204653 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:10.204658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:10.205463 (+ 805us) server_negotiation.cc:407] Connection header received
0810 01:42:10.206836 (+ 1373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:10.206839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:10.206893 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:10.206965 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:10.208339 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.208923 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.210475 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.210736 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.210812 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:10.213513 (+ 2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:10.213517 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:10.213519 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:10.213543 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:10.214908 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:10.215353 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:10.215356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:10.215357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:10.215428 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:10.215713 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:10.215717 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:10.215719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:10.215937 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:10.216027 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:10.216485 (+ 458us) server_negotiation.cc:299] Negotiation successful
0810 01:42:10.216615 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
I20260810 01:42:10.217479 21883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:10.204858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39593 (local address 127.16.58.66:39301)
0810 01:42:10.205324 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:10.205377 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:10.206640 (+ 1263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:10.207147 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:10.207154 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:10.207539 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:10.208180 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:10.208198 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.209051 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.209054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:10.210361 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:10.210374 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.210882 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.210887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:10.211072 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:10.211608 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:10.211629 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:10.213360 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:10.215011 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:10.215017 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:10.215030 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:10.215275 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:10.215488 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:10.215490 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:10.215491 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:10.215619 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:10.216037 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:10.216043 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:10.216265 (+ 222us) client_negotiation.cc:769] Sending connection context
0810 01:42:10.216420 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 01:42:10.216706 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":109,"threads_started":1}
I20260810 01:42:10.219515 21878 heartbeater.cc:347] Connected to a master server at 127.16.58.126:39593
I20260810 01:42:10.219727 21878 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:10.220175 21878 heartbeater.cc:511] Master 127.16.58.126:39593 requested a full tablet report, sending...
I20260810 01:42:10.221254 21385 ts_manager.cc:194] Registered new tserver with Master: 1167f8eb4d8248fdaa56aec484c9119f (127.16.58.66:44575)
I20260810 01:42:10.222000 21385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:39301
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:42:10.230307 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39593
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:10.335979 21889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:10.336195 21889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:10.336236 21889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:10.340051 21889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:10.340099 21889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:10.340154 21889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:10.345080 21889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:10.345906 21889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:10.346741 21889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:10.355420 21903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:10.355429 21901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:10.355427 21906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:10.355664 21889 server_base.cc:1034] running on GCE node
I20260810 01:42:10.356043 21889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:10.356575 21889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:10.357726 21889 hybrid_clock.cc:648] HybridClock initialized: now 1786326130357716 us; error 27 us; skew 500 ppm
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:10.360198 21889 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:42:10.360986 21889 webserver.cc:460] Webserver started at http://127.16.58.67:39679/ using document root <none> and password file <none>
I20260810 01:42:10.361469 21889 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:10.361532 21889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:10.361763 21889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:10.363662 21889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "cecf1bd338804b75aafc0954081c1c4d"
format_stamp: "Formatted at 2026-08-10 01:42:10 on dist-test-slave-jlzn"
server_key: "a324759bac44e9bbf219a0aec0a4c80e"
server_key_iv: "0b7cce8960e875d87e12b7fc0c222b71"
server_key_version: "encryptionkey@0"
I20260810 01:42:10.364209 21889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "cecf1bd338804b75aafc0954081c1c4d"
format_stamp: "Formatted at 2026-08-10 01:42:10 on dist-test-slave-jlzn"
server_key: "a324759bac44e9bbf219a0aec0a4c80e"
server_key_iv: "0b7cce8960e875d87e12b7fc0c222b71"
server_key_version: "encryptionkey@0"
I20260810 01:42:10.367416 21889 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:42:10.369585 21917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:10.370635 21889 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:10.370738 21889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "cecf1bd338804b75aafc0954081c1c4d"
format_stamp: "Formatted at 2026-08-10 01:42:10 on dist-test-slave-jlzn"
server_key: "a324759bac44e9bbf219a0aec0a4c80e"
server_key_iv: "0b7cce8960e875d87e12b7fc0c222b71"
server_key_version: "encryptionkey@0"
I20260810 01:42:10.370826 21889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:10.385290 21889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:10.387677 21889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:10.387862 21889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:10.388365 21889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:10.389070 21889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:10.389117 21889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:10.389173 21889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:10.389202 21889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:10.397115 21889 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:46453
I20260810 01:42:10.397145 22085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:46453 every 8 connection(s)
I20260810 01:42:10.397847 21889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:10.405773 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 21889
I20260810 01:42:10.405869 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326130, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:10.406122 16617 external_mini_cluster.cc:1428] Setting key 890e5fb1866ec391d8338a84ea8ee224
I20260810 01:42:10.409703 21442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:10.399365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:47687 (local address 127.16.58.126:39593)
0810 01:42:10.399490 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:10.399493 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:10.400201 (+ 708us) server_negotiation.cc:407] Connection header received
0810 01:42:10.401416 (+ 1215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:10.401420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:10.401476 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:10.401550 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:10.402583 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.403119 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.404221 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.404446 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.404533 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:10.406694 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:10.406698 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:10.406700 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:10.406728 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:10.408185 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:10.408593 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:10.408595 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:10.408596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:10.408673 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:10.408912 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:10.408913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:10.408914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:10.409064 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:10.409130 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:10.409495 (+ 365us) server_negotiation.cc:299] Negotiation successful
0810 01:42:10.409581 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:42:10.410341 22088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:10.399640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39593 (local address 127.16.58.67:47687)
0810 01:42:10.400061 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:10.400098 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:10.401221 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:10.401710 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:10.401717 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:10.402022 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:10.402442 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:10.402453 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.403234 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.403237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:10.404103 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:10.404112 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.404575 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.404579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:10.404728 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:10.405143 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:10.405158 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:10.406527 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:10.408273 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:10.408277 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:10.408287 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:10.408519 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:10.408733 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:10.408735 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:10.408736 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:10.408849 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:10.409128 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:10.409133 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:10.409331 (+ 198us) client_negotiation.cc:769] Sending connection context
0810 01:42:10.409464 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 01:42:10.409671 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":113,"threads_started":1}
I20260810 01:42:10.411248 22086 heartbeater.cc:347] Connected to a master server at 127.16.58.126:39593
I20260810 01:42:10.411440 22086 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:10.411880 22086 heartbeater.cc:511] Master 127.16.58.126:39593 requested a full tablet report, sending...
I20260810 01:42:10.412781 21385 ts_manager.cc:194] Registered new tserver with Master: cecf1bd338804b75aafc0954081c1c4d (127.16.58.67:46453)
I20260810 01:42:10.413292 21385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:47687
I20260810 01:42:10.419463 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[21319](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326130, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[21319](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326130, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:10.443517 21442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:10.436515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58704 (local address 127.16.58.126:39593)
0810 01:42:10.436627 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:10.436639 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:10.436784 (+ 145us) server_negotiation.cc:407] Connection header received
0810 01:42:10.436878 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:10.436880 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:10.436914 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:10.436976 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:10.437564 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.438038 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.438760 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:10.438950 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:10.439012 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:10.441069 (+ 2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:10.441072 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:10.441074 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:10.441096 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:10.442282 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:10.442585 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:10.442587 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:10.442589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:10.442661 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:10.442836 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:10.442838 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:10.442839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:10.443021 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:10.443115 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:10.443278 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 01:42:10.443368 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260810 01:42:10.443883 21385 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:58704
I20260810 01:42:10.444561 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 21475
I20260810 01:42:10.469959 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 21676
I20260810 01:42:10.478641 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 21889
I20260810 01:42:10.490399 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 21339
2026-08-10T01:42:10Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2161 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[22105](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[22105](info): set up 2 sockets
Aug 10 01:42:10 dist-test-slave-jlzn krb5kdc[22105](info): commencing operation
krb5kdc: starting...
W20260810 01:42:11.619199 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:11 dist-test-slave-jlzn krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:42:11.736123 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:44793
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:44793
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:11.841883 22125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:11.842105 22125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:11.842159 22125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:11.845981 22125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:11.846029 22125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:11.846055 22125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:11.846081 22125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:11.846100 22125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:11.851001 22125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:44793
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:44793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:11.851897 22125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:11.852775 22125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:11.860486 22125 server_base.cc:1034] running on GCE node
W20260810 01:42:11.860428 22130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:11.860591 22133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:11.860428 22138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:11.861241 22125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:11.862210 22125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:11.863368 22125 hybrid_clock.cc:648] HybridClock initialized: now 1786326131863347 us; error 30 us; skew 500 ppm
Aug 10 01:42:11 dist-test-slave-jlzn krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326131, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:11.865882 22125 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:42:11.866684 22125 webserver.cc:460] Webserver started at http://127.16.58.126:35897/ using document root <none> and password file <none>
I20260810 01:42:11.867154 22125 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:11.867211 22125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:11.867372 22125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:11.869239 22125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "c8dca76fb758489bbe59ad85504ca211"
format_stamp: "Formatted at 2026-08-10 01:42:11 on dist-test-slave-jlzn"
server_key: "4d787e7c7576e5020317c98d2c7a1f5a"
server_key_iv: "a09dc5d4f4eb685d7f2dcfe6c564cd5f"
server_key_version: "encryptionkey@0"
I20260810 01:42:11.869720 22125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "c8dca76fb758489bbe59ad85504ca211"
format_stamp: "Formatted at 2026-08-10 01:42:11 on dist-test-slave-jlzn"
server_key: "4d787e7c7576e5020317c98d2c7a1f5a"
server_key_iv: "a09dc5d4f4eb685d7f2dcfe6c564cd5f"
server_key_version: "encryptionkey@0"
I20260810 01:42:11.873272 22125 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 01:42:11.875432 22145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:11.876581 22125 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:11.876694 22125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "c8dca76fb758489bbe59ad85504ca211"
format_stamp: "Formatted at 2026-08-10 01:42:11 on dist-test-slave-jlzn"
server_key: "4d787e7c7576e5020317c98d2c7a1f5a"
server_key_iv: "a09dc5d4f4eb685d7f2dcfe6c564cd5f"
server_key_version: "encryptionkey@0"
I20260810 01:42:11.876777 22125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:11.911211 22125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:11.913813 22125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:11.913977 22125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:11.920513 22125 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:44793
I20260810 01:42:11.920585 22224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:44793 every 8 connection(s)
I20260810 01:42:11.921394 22125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:11.923971 22225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:11.929111 22225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211: Bootstrap starting.
I20260810 01:42:11.931370 22225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:11.931579 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 22125
I20260810 01:42:11.931721 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:11.932027 16617 external_mini_cluster.cc:1428] Setting key 675254565f5ccf28293de3a706503570
I20260810 01:42:11.932291 22225 log.cc:824] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:11.934165 22225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211: No bootstrap required, opened a new log
I20260810 01:42:11.937495 22225 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8dca76fb758489bbe59ad85504ca211" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44793 } }
I20260810 01:42:11.937714 22225 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:11.937752 22225 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8dca76fb758489bbe59ad85504ca211, State: Initialized, Role: FOLLOWER
I20260810 01:42:11.938163 22225 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8dca76fb758489bbe59ad85504ca211" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44793 } }
I20260810 01:42:11.938287 22225 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:11.938349 22225 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:11.938441 22225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:11.939505 22225 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8dca76fb758489bbe59ad85504ca211" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44793 } }
I20260810 01:42:11.939860 22225 leader_election.cc:302] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8dca76fb758489bbe59ad85504ca211; no voters:
Aug 10 01:42:11 dist-test-slave-jlzn krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:11.940151 22225 leader_election.cc:288] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:11.940270 22231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:11.940470 22231 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [term 1 LEADER]: Becoming Leader. State: Replica: c8dca76fb758489bbe59ad85504ca211, State: Running, Role: LEADER
I20260810 01:42:11.940819 22231 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8dca76fb758489bbe59ad85504ca211" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44793 } }
I20260810 01:42:11.941378 22225 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:11.942353 22235 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8dca76fb758489bbe59ad85504ca211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8dca76fb758489bbe59ad85504ca211" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44793 } } }
I20260810 01:42:11.942473 22235 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:11.942852 22236 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8dca76fb758489bbe59ad85504ca211. Latest consensus state: current_term: 1 leader_uuid: "c8dca76fb758489bbe59ad85504ca211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8dca76fb758489bbe59ad85504ca211" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44793 } } }
I20260810 01:42:11.943014 22236 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:11.943827 22247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:11.945612 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:11.933090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57916 (local address 127.16.58.126:44793)
0810 01:42:11.933487 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:11.933501 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:11.933534 (+ 33us) server_negotiation.cc:407] Connection header received
0810 01:42:11.934148 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:11.934164 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:11.934479 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:11.934765 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:11.935541 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:11.936528 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:11.937350 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:11.937844 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:11.937984 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:11.940712 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:11.940718 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:11.940733 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:11.940764 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:11.942697 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:11.943247 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:11.943253 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:11.943258 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:11.943392 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:11.943688 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:11.943691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:11.943693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:11.944216 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:11.944389 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:11.944715 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 01:42:11.944971 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":110,"threads_started":1}
I20260810 01:42:11.946981 22247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:11.951844 22247 catalog_manager.cc:1347] Generated new cluster ID: d964d32a902f4607b7be5d8ac6261d1b
I20260810 01:42:11.951905 22247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:11.958386 22247 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:11.959178 22247 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:11.966945 22247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8dca76fb758489bbe59ad85504ca211: Generated new TSK 0
I20260810 01:42:11.967466 22247 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:42:11.995535 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44793
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:12.101867 22264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:12.102100 22264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:12.102164 22264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:12.106067 22264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:12.106127 22264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:12.106204 22264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:12.111202 22264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:12.112116 22264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:12.113022 22264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:12.121969 22272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:12.121935 22270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:12.121991 22275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:12.122229 22264 server_base.cc:1034] running on GCE node
I20260810 01:42:12.122591 22264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:12.123178 22264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:12.124332 22264 hybrid_clock.cc:648] HybridClock initialized: now 1786326132124319 us; error 24 us; skew 500 ppm
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326132, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:12.126814 22264 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:42:12.127600 22264 webserver.cc:460] Webserver started at http://127.16.58.65:42323/ using document root <none> and password file <none>
I20260810 01:42:12.128139 22264 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:12.128206 22264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:12.128397 22264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:12.130322 22264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "a755444d0158416d81f73299356cca14"
format_stamp: "Formatted at 2026-08-10 01:42:12 on dist-test-slave-jlzn"
server_key: "30001e1ab64e1779f3e0e17b3f7352a7"
server_key_iv: "bac41372351d098e25596d9620e53772"
server_key_version: "encryptionkey@0"
I20260810 01:42:12.130841 22264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "a755444d0158416d81f73299356cca14"
format_stamp: "Formatted at 2026-08-10 01:42:12 on dist-test-slave-jlzn"
server_key: "30001e1ab64e1779f3e0e17b3f7352a7"
server_key_iv: "bac41372351d098e25596d9620e53772"
server_key_version: "encryptionkey@0"
I20260810 01:42:12.134225 22264 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:42:12.136386 22287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:12.137455 22264 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:12.137562 22264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "a755444d0158416d81f73299356cca14"
format_stamp: "Formatted at 2026-08-10 01:42:12 on dist-test-slave-jlzn"
server_key: "30001e1ab64e1779f3e0e17b3f7352a7"
server_key_iv: "bac41372351d098e25596d9620e53772"
server_key_version: "encryptionkey@0"
I20260810 01:42:12.137650 22264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:12.149513 22264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:12.151959 22264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:12.152117 22264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:12.152628 22264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:12.153371 22264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:12.153419 22264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:12.153468 22264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:12.153497 22264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:12.161564 22264 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:40119
I20260810 01:42:12.161594 22450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:40119 every 8 connection(s)
I20260810 01:42:12.162346 22264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:12.170938 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 22264
I20260810 01:42:12.171046 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326132, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:12.171324 16617 external_mini_cluster.cc:1428] Setting key 1a2a34309c643d53d9cacb511559788d
I20260810 01:42:12.175395 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:12.163925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:54731 (local address 127.16.58.126:44793)
0810 01:42:12.164043 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:12.164046 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:12.164814 (+ 768us) server_negotiation.cc:407] Connection header received
0810 01:42:12.166306 (+ 1492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:12.166310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:12.166367 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:12.166436 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:12.167494 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.168077 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.169187 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.169414 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.169502 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:12.171764 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:12.171767 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:12.171770 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:12.171794 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:12.173403 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.173878 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.173882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.173883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.173975 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.174253 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.174256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.174258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.174462 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:12.174551 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:12.175139 (+ 588us) server_negotiation.cc:299] Negotiation successful
0810 01:42:12.175271 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:42:12.176330 22453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:12.164243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:44793 (local address 127.16.58.65:54731)
0810 01:42:12.164677 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:12.164716 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:12.166110 (+ 1394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:12.166606 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:12.166612 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:12.166930 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:12.167351 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:12.167364 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.168210 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.168214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:12.169062 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:12.169072 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.169550 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.169555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:12.169714 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:12.170168 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:12.170183 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:12.171580 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:12.173522 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:12.173527 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:12.173538 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:12.173789 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:12.174052 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:12.174054 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:12.174055 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:12.174177 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:12.174565 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:12.174571 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:12.174874 (+ 303us) client_negotiation.cc:769] Sending connection context
0810 01:42:12.175063 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 01:42:12.175370 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":108,"threads_started":1}
I20260810 01:42:12.177501 22451 heartbeater.cc:347] Connected to a master server at 127.16.58.126:44793
I20260810 01:42:12.177776 22451 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:12.178326 22451 heartbeater.cc:511] Master 127.16.58.126:44793 requested a full tablet report, sending...
I20260810 01:42:12.179936 22173 ts_manager.cc:194] Registered new tserver with Master: a755444d0158416d81f73299356cca14 (127.16.58.65:40119)
I20260810 01:42:12.181142 22173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:54731
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:42:12.198320 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44793
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:12.304728 22458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:12.304950 22458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:12.304992 22458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:12.308843 22458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:12.308890 22458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:12.308959 22458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:12.313871 22458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:12.314740 22458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:12.315627 22458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:12.324352 22467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:12.324450 22470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:12.324339 22468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:12.324555 22458 server_base.cc:1034] running on GCE node
I20260810 01:42:12.324990 22458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:12.325570 22458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:12.326720 22458 hybrid_clock.cc:648] HybridClock initialized: now 1786326132326705 us; error 26 us; skew 500 ppm
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326132, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:12.329281 22458 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:42:12.330077 22458 webserver.cc:460] Webserver started at http://127.16.58.66:46073/ using document root <none> and password file <none>
I20260810 01:42:12.330564 22458 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:12.330628 22458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:12.330829 22458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:12.332758 22458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "5506ba0225d2418f85efdd2dbe885961"
format_stamp: "Formatted at 2026-08-10 01:42:12 on dist-test-slave-jlzn"
server_key: "e2e16b38b4d4d2baeba2982dba5d8618"
server_key_iv: "caa2d236b7be665c3bf8c0efadf1752d"
server_key_version: "encryptionkey@0"
I20260810 01:42:12.333280 22458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "5506ba0225d2418f85efdd2dbe885961"
format_stamp: "Formatted at 2026-08-10 01:42:12 on dist-test-slave-jlzn"
server_key: "e2e16b38b4d4d2baeba2982dba5d8618"
server_key_iv: "caa2d236b7be665c3bf8c0efadf1752d"
server_key_version: "encryptionkey@0"
I20260810 01:42:12.336585 22458 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:12.338729 22477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:12.339887 22458 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:12.339988 22458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "5506ba0225d2418f85efdd2dbe885961"
format_stamp: "Formatted at 2026-08-10 01:42:12 on dist-test-slave-jlzn"
server_key: "e2e16b38b4d4d2baeba2982dba5d8618"
server_key_iv: "caa2d236b7be665c3bf8c0efadf1752d"
server_key_version: "encryptionkey@0"
I20260810 01:42:12.340075 22458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:12.356292 22458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:12.359014 22458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:12.359167 22458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:12.359673 22458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:12.360426 22458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:12.360474 22458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:12.360522 22458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:12.360550 22458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:12.368530 22458 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:41041
I20260810 01:42:12.368557 22650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:41041 every 8 connection(s)
I20260810 01:42:12.369270 22458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:12.373667 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 22458
I20260810 01:42:12.373788 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:12.374089 16617 external_mini_cluster.cc:1428] Setting key c8cb41129efef890c188b2079077ac32
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326132, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:12.382648 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:12.370830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:60817 (local address 127.16.58.126:44793)
0810 01:42:12.370949 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:12.370960 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:12.371710 (+ 750us) server_negotiation.cc:407] Connection header received
0810 01:42:12.373019 (+ 1309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:12.373022 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:12.373086 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:12.373166 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:12.374550 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.375215 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.376519 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.376820 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.376922 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:12.379262 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:12.379266 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:12.379268 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:12.379296 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:12.380774 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.381262 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.381265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.381267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.381362 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.381642 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.381645 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.381647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.381866 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:12.381965 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:12.382362 (+ 397us) server_negotiation.cc:299] Negotiation successful
0810 01:42:12.382485 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:42:12.383260 22654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:12.371128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:44793 (local address 127.16.58.66:60817)
0810 01:42:12.371572 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:12.371610 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:12.372826 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:12.373331 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:12.373337 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:12.373768 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:12.374364 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:12.374384 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.375345 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.375349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:12.376402 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:12.376412 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.376946 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.376948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:12.377074 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:12.377548 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:12.377570 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:12.379104 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:12.380879 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:12.380885 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:12.380898 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:12.381172 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:12.381440 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:12.381442 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:12.381443 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:12.381560 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:12.381956 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:12.381960 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:12.382156 (+ 196us) client_negotiation.cc:769] Sending connection context
0810 01:42:12.382288 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 01:42:12.382497 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":109,"threads_started":1}
I20260810 01:42:12.384266 22652 heartbeater.cc:347] Connected to a master server at 127.16.58.126:44793
I20260810 01:42:12.384498 22652 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:42:12.385001 22652 heartbeater.cc:511] Master 127.16.58.126:44793 requested a full tablet report, sending...
I20260810 01:42:12.386013 22173 ts_manager.cc:194] Registered new tserver with Master: 5506ba0225d2418f85efdd2dbe885961 (127.16.58.66:41041)
I20260810 01:42:12.386528 22173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:60817
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:42:12.400341 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44793
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:12.507891 22657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:12.508116 22657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:12.508157 22657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:12.512044 22657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:12.512091 22657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:12.512146 22657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:12.517089 22657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:12.517935 22657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:12.518870 22657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:12.527695 22666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:12.527730 22663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:12.527730 22662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:12.528019 22657 server_base.cc:1034] running on GCE node
I20260810 01:42:12.528391 22657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:12.528959 22657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:12.530122 22657 hybrid_clock.cc:648] HybridClock initialized: now 1786326132530107 us; error 28 us; skew 500 ppm
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326132, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:12.532656 22657 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:42:12.533434 22657 webserver.cc:460] Webserver started at http://127.16.58.67:39915/ using document root <none> and password file <none>
I20260810 01:42:12.533915 22657 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:12.533970 22657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:12.534128 22657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:12.536070 22657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "1ed00abf45114f03a473bb7fcab31a5a"
format_stamp: "Formatted at 2026-08-10 01:42:12 on dist-test-slave-jlzn"
server_key: "99328bd879e15d78a9c33862a5a7802b"
server_key_iv: "af36aaffa00265531345861a343cd8d8"
server_key_version: "encryptionkey@0"
I20260810 01:42:12.536564 22657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "1ed00abf45114f03a473bb7fcab31a5a"
format_stamp: "Formatted at 2026-08-10 01:42:12 on dist-test-slave-jlzn"
server_key: "99328bd879e15d78a9c33862a5a7802b"
server_key_iv: "af36aaffa00265531345861a343cd8d8"
server_key_version: "encryptionkey@0"
I20260810 01:42:12.539835 22657 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:42:12.542088 22676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:12.543229 22657 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:12.543346 22657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "1ed00abf45114f03a473bb7fcab31a5a"
format_stamp: "Formatted at 2026-08-10 01:42:12 on dist-test-slave-jlzn"
server_key: "99328bd879e15d78a9c33862a5a7802b"
server_key_iv: "af36aaffa00265531345861a343cd8d8"
server_key_version: "encryptionkey@0"
I20260810 01:42:12.543437 22657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:12.558617 22657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:12.561028 22657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:12.561184 22657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:12.561681 22657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:12.562408 22657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:12.562453 22657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:12.562492 22657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:12.562520 22657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:12.570398 22657 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:36413
I20260810 01:42:12.570429 22845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:36413 every 8 connection(s)
I20260810 01:42:12.571154 22657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:12.575896 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 22657
I20260810 01:42:12.576012 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:12.576331 16617 external_mini_cluster.cc:1428] Setting key b318a1f253cb775283e912488f8daa01
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326132, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:12.583778 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:12.572758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:45075 (local address 127.16.58.126:44793)
0810 01:42:12.572880 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:12.572884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:12.573593 (+ 709us) server_negotiation.cc:407] Connection header received
0810 01:42:12.574866 (+ 1273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:12.574869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:12.574926 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:12.575000 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:12.576272 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.576926 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.578252 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.578488 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.578569 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:12.580806 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:12.580809 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:12.580811 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:12.580835 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:12.581935 (+ 1100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.582401 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.582404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.582406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.582485 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.582784 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.582787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.582788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.582961 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:12.583045 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:12.583492 (+ 447us) server_negotiation.cc:299] Negotiation successful
0810 01:42:12.583610 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:42:12.584478 22848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:12.573062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:44793 (local address 127.16.58.67:45075)
0810 01:42:12.573466 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:12.573503 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:12.574673 (+ 1170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:12.575180 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:12.575189 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:12.575512 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:12.576118 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:12.576139 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.577062 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.577066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:12.578134 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:12.578145 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.578607 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.578610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:12.578749 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:12.579187 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:12.579202 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:12.580625 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:12.582040 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:12.582045 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:12.582058 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:12.582309 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:12.582566 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:12.582569 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:12.582571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:12.582697 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:12.583057 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:12.583063 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:12.583280 (+ 217us) client_negotiation.cc:769] Sending connection context
0810 01:42:12.583431 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 01:42:12.583732 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":101,"threads_started":1}
I20260810 01:42:12.585453 22846 heartbeater.cc:347] Connected to a master server at 127.16.58.126:44793
I20260810 01:42:12.585640 22846 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:12.586018 22846 heartbeater.cc:511] Master 127.16.58.126:44793 requested a full tablet report, sending...
I20260810 01:42:12.586901 22173 ts_manager.cc:194] Registered new tserver with Master: 1ed00abf45114f03a473bb7fcab31a5a (127.16.58.67:36413)
I20260810 01:42:12.587419 22173 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:45075
I20260810 01:42:12.589684 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:42:12.614416 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:12.606256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50336 (local address 127.16.58.65:40119)
0810 01:42:12.606563 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:12.606572 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:12.606592 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:42:12.606635 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:12.606640 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:12.606777 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:12.606892 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:12.607548 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.608334 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.609148 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.609478 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.609570 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:12.611677 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:12.611686 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:12.611696 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:12.611720 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:12.613004 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.613380 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.613384 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.613386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.613456 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.613642 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.613643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.613644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.613866 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:12.614000 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:12.614164 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 01:42:12.614278 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":97,"threads_started":1}
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:12.623764 22230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:12.616717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57928 (local address 127.16.58.126:44793)
0810 01:42:12.616830 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:12.616835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:12.616901 (+ 66us) server_negotiation.cc:407] Connection header received
0810 01:42:12.617013 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:12.617016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:12.617058 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:12.617116 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:12.617672 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.618157 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.618874 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:12.619092 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:12.619175 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:12.621236 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:12.621240 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:12.621242 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:12.621266 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:12.622295 (+ 1029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.622664 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.622667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.622669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.622742 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:12.622974 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:12.622977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:12.622979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:12.623186 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:12.623301 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:12.623514 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 01:42:12.623616 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
W20260810 01:42:12.624125 22173 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57928
I20260810 01:42:12.624616 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 22264
I20260810 01:42:12.646569 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 22458
I20260810 01:42:12.656848 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 22657
I20260810 01:42:12.667269 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 22125
2026-08-10T01:42:12Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2175 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22866](info): set up 2 sockets
Aug 10 01:42:12 dist-test-slave-jlzn krb5kdc[22866](info): commencing operation
krb5kdc: starting...
W20260810 01:42:13.792016 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:13 dist-test-slave-jlzn krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:42:13.910174 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:43237
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:44221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:43237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:14.016597 22886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:14.016834 22886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:14.016872 22886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:14.020717 22886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:14.020764 22886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:14.020782 22886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:14.020799 22886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:14.020815 22886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:14.025727 22886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:43237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:43237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:14.026585 22886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:14.027472 22886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:14.035063 22896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:14.035072 22900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:14.035087 22898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:14.035341 22886 server_base.cc:1034] running on GCE node
I20260810 01:42:14.035920 22886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:14.036916 22886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:14.038070 22886 hybrid_clock.cc:648] HybridClock initialized: now 1786326134038055 us; error 25 us; skew 500 ppm
Aug 10 01:42:14 dist-test-slave-jlzn krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326134, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:14.040725 22886 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:42:14.041375 22886 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:14.041443 22886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:14.041620 22886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:14.043519 22886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "63cca2234cb84ef6a309b66a18ab784f"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "ec2779b826be5d3e24f7bdc4e3f1228a"
server_key_iv: "f467c616ff8ab362d80e56bed3057cc0"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.044081 22886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "63cca2234cb84ef6a309b66a18ab784f"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "ec2779b826be5d3e24f7bdc4e3f1228a"
server_key_iv: "f467c616ff8ab362d80e56bed3057cc0"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.047451 22886 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:42:14.049680 22907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.050732 22886 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:14.050844 22886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "63cca2234cb84ef6a309b66a18ab784f"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "ec2779b826be5d3e24f7bdc4e3f1228a"
server_key_iv: "f467c616ff8ab362d80e56bed3057cc0"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.050930 22886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:14.070963 22886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:14.073889 22886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:14.074051 22886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:14.080519 22886 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:43237
I20260810 01:42:14.080776 22983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:43237 every 8 connection(s)
I20260810 01:42:14.081135 22886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:14.083758 22984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:14.085331 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 22886
I20260810 01:42:14.085454 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:14.085701 16617 external_mini_cluster.cc:1428] Setting key c60d53920c9477140edd97eec9db08a0
I20260810 01:42:14.090157 22984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f: Bootstrap starting.
I20260810 01:42:14.092746 22984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:14.093479 22984 log.cc:824] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:42:14 dist-test-slave-jlzn krb5kdc[22866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:14.095587 22984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f: No bootstrap required, opened a new log
I20260810 01:42:14.099501 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.086979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60846 (local address 127.16.58.126:43237)
0810 01:42:14.087396 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.087414 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.087454 (+ 40us) server_negotiation.cc:407] Connection header received
0810 01:42:14.088272 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.088296 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.088728 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.089085 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:14.089703 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.091084 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.091950 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.092615 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.092791 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.095314 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:14.095319 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:14.095331 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:14.095356 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:14.096855 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.097324 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.097329 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.097333 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.097440 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.097705 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.097707 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.097708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.098062 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:14.098206 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.098467 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.098714 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":112,"threads_started":1}
I20260810 01:42:14.099386 22984 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cca2234cb84ef6a309b66a18ab784f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43237 } }
I20260810 01:42:14.099601 22984 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:14.099653 22984 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63cca2234cb84ef6a309b66a18ab784f, State: Initialized, Role: FOLLOWER
I20260810 01:42:14.100160 22984 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cca2234cb84ef6a309b66a18ab784f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43237 } }
I20260810 01:42:14.100318 22984 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:14.100379 22984 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:14.100471 22984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:14.101325 22984 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cca2234cb84ef6a309b66a18ab784f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43237 } }
I20260810 01:42:14.101640 22984 leader_election.cc:302] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63cca2234cb84ef6a309b66a18ab784f; no voters:
I20260810 01:42:14.101923 22984 leader_election.cc:288] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:14.102003 22993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:14.102205 22993 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [term 1 LEADER]: Becoming Leader. State: Replica: 63cca2234cb84ef6a309b66a18ab784f, State: Running, Role: LEADER
I20260810 01:42:14.102547 22993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cca2234cb84ef6a309b66a18ab784f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43237 } }
I20260810 01:42:14.103021 22984 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:14.104123 22994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63cca2234cb84ef6a309b66a18ab784f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cca2234cb84ef6a309b66a18ab784f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43237 } } }
I20260810 01:42:14.104123 22995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63cca2234cb84ef6a309b66a18ab784f. Latest consensus state: current_term: 1 leader_uuid: "63cca2234cb84ef6a309b66a18ab784f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63cca2234cb84ef6a309b66a18ab784f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 43237 } } }
I20260810 01:42:14.104286 22995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:14.104286 22994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:14.104699 23004 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:14.107438 23004 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:14.112900 23004 catalog_manager.cc:1347] Generated new cluster ID: 2b70640be8914705bcd47f8f5ad1ed98
I20260810 01:42:14.112951 23004 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:14.121222 23004 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:14.122033 23004 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:14.125931 23004 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f: Generated new TSK 0
I20260810 01:42:14.126478 23004 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:42:14.152500 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43237
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:44221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:14.260731 23022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:14.260949 23022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:14.260994 23022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:14.264846 23022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:14.264896 23022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:14.264964 23022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:14.269903 23022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:14.270803 23022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:14.271731 23022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:14.280789 23034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:14.280814 23022 server_base.cc:1034] running on GCE node
W20260810 01:42:14.280789 23032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:14.281008 23031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:14.281381 23022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:14.281908 23022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:14.283056 23022 hybrid_clock.cc:648] HybridClock initialized: now 1786326134283033 us; error 33 us; skew 500 ppm
Aug 10 01:42:14 dist-test-slave-jlzn krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326134, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:14.285683 23022 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:42:14.286324 23022 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:14.286383 23022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:14.286538 23022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:14.288494 23022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "85036993f52a4579b1489d7afb0da857"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "247e53678d122ed3766eb11d5793dba3"
server_key_iv: "a563c0cc69bb3b4286d244dd4a10014e"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.289002 23022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "85036993f52a4579b1489d7afb0da857"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "247e53678d122ed3766eb11d5793dba3"
server_key_iv: "a563c0cc69bb3b4286d244dd4a10014e"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.292392 23022 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:42:14.294541 23042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.295650 23022 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:14.295761 23022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "85036993f52a4579b1489d7afb0da857"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "247e53678d122ed3766eb11d5793dba3"
server_key_iv: "a563c0cc69bb3b4286d244dd4a10014e"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.295892 23022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:14.315162 23022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:14.317701 23022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:14.317857 23022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:14.318372 23022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:14.319113 23022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:14.319166 23022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.319206 23022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:14.319236 23022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.327414 23022 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:46243
I20260810 01:42:14.327435 23199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:46243 every 8 connection(s)
I20260810 01:42:14.327941 23022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:14.328145 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 23022
I20260810 01:42:14.328258 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:14.328567 16617 external_mini_cluster.cc:1428] Setting key 0e54794da73804f95c449b377db9f189
Aug 10 01:42:14 dist-test-slave-jlzn krb5kdc[22866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326134, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
I20260810 01:42:14.340798 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.329709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:35419 (local address 127.16.58.126:43237)
0810 01:42:14.329840 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.329845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.330709 (+ 864us) server_negotiation.cc:407] Connection header received
0810 01:42:14.331986 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.331989 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.332043 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.332112 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:14.333198 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.333725 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.334912 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.335146 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.335235 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.337482 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:14.337485 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:14.337487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:14.337511 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:14.338838 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.339394 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.339397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.339398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.339474 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.339789 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.339792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.339794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.340001 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:14.340100 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.340554 (+ 454us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.340677 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:42:14.341583 23207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.330117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43237 (local address 127.16.58.65:35419)
0810 01:42:14.330570 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:14.330610 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:14.331760 (+ 1150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:14.332291 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:14.332297 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:14.332632 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:14.333057 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.333070 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.333844 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.333847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.334798 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.334809 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.335280 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.335284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.335441 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.335987 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:14.336002 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:14.337330 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:14.338947 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:14.338952 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:14.338965 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:14.339299 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:14.339555 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:14.339558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:14.339560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:14.339701 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:14.340126 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:14.340132 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:14.340347 (+ 215us) client_negotiation.cc:769] Sending connection context
0810 01:42:14.340501 (+ 154us) client_negotiation.cc:240] Negotiation successful
0810 01:42:14.340779 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":129,"threads_started":1}
I20260810 01:42:14.342660 23201 heartbeater.cc:347] Connected to a master server at 127.16.58.126:43237
I20260810 01:42:14.342900 23201 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:14.343412 23201 heartbeater.cc:511] Master 127.16.58.126:43237 requested a full tablet report, sending...
I20260810 01:42:14.344869 22930 ts_manager.cc:194] Registered new tserver with Master: 85036993f52a4579b1489d7afb0da857 (127.16.58.65:46243)
I20260810 01:42:14.345945 22930 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:35419
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:42:14.354458 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43237
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:44221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:14.461753 23212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:14.461971 23212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:14.462011 23212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:14.465881 23212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:14.465926 23212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:14.465981 23212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:14.470906 23212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:14.471771 23212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:14.472697 23212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:14.481381 23222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:14.481438 23225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:14.481396 23221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:14.481583 23212 server_base.cc:1034] running on GCE node
I20260810 01:42:14.482028 23212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:14.482573 23212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:14.483714 23212 hybrid_clock.cc:648] HybridClock initialized: now 1786326134483692 us; error 34 us; skew 500 ppm
Aug 10 01:42:14 dist-test-slave-jlzn krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326134, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:14.486304 23212 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:42:14.486943 23212 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:14.487010 23212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:14.487193 23212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:14.489049 23212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "8fc8a4645313a9cae6df945619b888b9"
server_key_iv: "b1bda66e28177dd0457ff187070fbf76"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.489615 23212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "8fc8a4645313a9cae6df945619b888b9"
server_key_iv: "b1bda66e28177dd0457ff187070fbf76"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.492995 23212 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:14.495116 23232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.496248 23212 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:14.496353 23212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "8fc8a4645313a9cae6df945619b888b9"
server_key_iv: "b1bda66e28177dd0457ff187070fbf76"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.496441 23212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:14.513947 23212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:14.516909 23212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:14.517084 23212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:14.517618 23212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:14.518409 23212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:14.518456 23212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.518508 23212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:14.518536 23212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.526448 23212 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:39095
I20260810 01:42:14.526477 23406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:39095 every 8 connection(s)
I20260810 01:42:14.526950 23212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:14.529917 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 23212
I20260810 01:42:14.530048 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:14.530360 16617 external_mini_cluster.cc:1428] Setting key a5e28e4e793983e0ccf5be7c3392a293
Aug 10 01:42:14 dist-test-slave-jlzn krb5kdc[22866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326134, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:14.540207 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.528508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:54771 (local address 127.16.58.126:43237)
0810 01:42:14.528642 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.528646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.529373 (+ 727us) server_negotiation.cc:407] Connection header received
0810 01:42:14.530867 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.530871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.530929 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.531001 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:14.532269 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.532773 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.534186 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.534501 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.534603 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.536970 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:14.536973 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:14.536975 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:14.537007 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:14.538320 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.538789 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.538792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.538793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.538870 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.539178 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.539181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.539183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.539351 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:14.539436 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.539921 (+ 485us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.540038 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:42:14.540910 23411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.528820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43237 (local address 127.16.58.66:54771)
0810 01:42:14.529242 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:14.529281 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:14.530658 (+ 1377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:14.531175 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:14.531181 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:14.531514 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:14.532097 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.532118 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.532892 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.532895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.534075 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.534085 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.534624 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.534626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.534769 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.535291 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:14.535310 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:14.536808 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:14.538429 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:14.538434 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:14.538447 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:14.538696 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:14.538951 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:14.538955 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:14.538957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:14.539086 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:14.539453 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:14.539460 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:14.539684 (+ 224us) client_negotiation.cc:769] Sending connection context
0810 01:42:14.539860 (+ 176us) client_negotiation.cc:240] Negotiation successful
0810 01:42:14.540152 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":112,"threads_started":1}
I20260810 01:42:14.541911 23407 heartbeater.cc:347] Connected to a master server at 127.16.58.126:43237
I20260810 01:42:14.542125 23407 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:14.542527 23407 heartbeater.cc:511] Master 127.16.58.126:43237 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
I20260810 01:42:14.543484 22930 ts_manager.cc:194] Registered new tserver with Master: adf7c3a6d21a4ff6bdc636d4ca28a958 (127.16.58.66:39095)
I20260810 01:42:14.544061 22930 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:54771
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:42:14.572099 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43237
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:44221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:14.680564 23414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:14.680783 23414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:14.680823 23414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:14.684666 23414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:14.684721 23414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:14.684796 23414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:14.689733 23414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:43237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:14.690616 23414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:14.691519 23414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:14.700251 23424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:14.700269 23428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:14.700270 23426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:14.700505 23414 server_base.cc:1034] running on GCE node
I20260810 01:42:14.700965 23414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:14.701524 23414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:14.702668 23414 hybrid_clock.cc:648] HybridClock initialized: now 1786326134702645 us; error 40 us; skew 500 ppm
Aug 10 01:42:14 dist-test-slave-jlzn krb5kdc[22866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326134, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:14.708765 23414 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:42:14.709981 23414 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:14.710059 23414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:14.710260 23414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:14.712208 23414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "1931d26c1c904c35918a9cb40fb88c27"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "db97f19a7780cb9c68df10b792dd625a"
server_key_iv: "411918ba965f2e2559193b4bdd556ade"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.712733 23414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "1931d26c1c904c35918a9cb40fb88c27"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "db97f19a7780cb9c68df10b792dd625a"
server_key_iv: "411918ba965f2e2559193b4bdd556ade"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.716089 23414 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:14.718278 23435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.719358 23414 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:14.719470 23414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "1931d26c1c904c35918a9cb40fb88c27"
format_stamp: "Formatted at 2026-08-10 01:42:14 on dist-test-slave-jlzn"
server_key: "db97f19a7780cb9c68df10b792dd625a"
server_key_iv: "411918ba965f2e2559193b4bdd556ade"
server_key_version: "encryptionkey@0"
I20260810 01:42:14.719561 23414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:14.736537 23414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:14.739418 23414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:14.739578 23414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:14.740195 23414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:14.740963 23414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:14.741011 23414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.741061 23414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:14.741091 23414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:14.750151 23414 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:38759
I20260810 01:42:14.750182 23602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:38759 every 8 connection(s)
I20260810 01:42:14.750710 23414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:14.758311 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 23414
I20260810 01:42:14.758407 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:14.758684 16617 external_mini_cluster.cc:1428] Setting key f1bddbb05daae1b642f53a9db8f74870
Aug 10 01:42:14 dist-test-slave-jlzn krb5kdc[22866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326134, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:14.763244 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.752365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:58259 (local address 127.16.58.126:43237)
0810 01:42:14.752487 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.752490 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.753277 (+ 787us) server_negotiation.cc:407] Connection header received
0810 01:42:14.754588 (+ 1311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.754591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.754651 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.754753 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:14.755952 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.756483 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.757554 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.757762 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.757831 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.760370 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:14.760374 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:14.760376 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:14.760400 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:14.761617 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.762072 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.762074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.762075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.762147 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.762405 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.762407 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.762408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.762565 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:14.762642 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.763039 (+ 397us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.763131 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:42:14.764017 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.752681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:43237 (local address 127.16.58.67:58259)
0810 01:42:14.753116 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:14.753165 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:14.754400 (+ 1235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:14.754904 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:14.754910 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:14.755301 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:14.755781 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.755797 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.756571 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.756573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.757463 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.757473 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.757868 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.757870 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.758010 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.758515 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:14.758530 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:14.760224 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:14.761729 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:14.761733 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:14.761744 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:14.761989 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:14.762214 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:14.762216 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:14.762218 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:14.762341 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:14.762640 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:14.762644 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:14.762853 (+ 209us) client_negotiation.cc:769] Sending connection context
0810 01:42:14.762997 (+ 144us) client_negotiation.cc:240] Negotiation successful
0810 01:42:14.763230 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":119,"threads_started":1}
I20260810 01:42:14.765002 23603 heartbeater.cc:347] Connected to a master server at 127.16.58.126:43237
I20260810 01:42:14.765208 23603 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:14.765601 23603 heartbeater.cc:511] Master 127.16.58.126:43237 requested a full tablet report, sending...
I20260810 01:42:14.766517 22930 ts_manager.cc:194] Registered new tserver with Master: 1931d26c1c904c35918a9cb40fb88c27 (127.16.58.67:38759)
I20260810 01:42:14.767022 22930 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:58259
I20260810 01:42:14.772174 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:42:14.780428 22990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.773944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60860 (local address 127.16.58.126:43237)
0810 01:42:14.774062 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.774067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.774247 (+ 180us) server_negotiation.cc:407] Connection header received
0810 01:42:14.774333 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.774335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.774370 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.774427 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:14.775021 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.775507 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.776290 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.776518 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.776599 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.777746 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:14.777748 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:14.777750 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:14.777769 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:14.778872 (+ 1103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.779266 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.779269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.779271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.779346 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:14.779584 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:14.779588 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:14.779589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:14.779844 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:14.779964 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.780189 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.780289 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:42:14.782934 22930 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60860:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:14.785877 22930 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:14.800366 23620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.794363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:39095 (local address 127.0.0.1:49722)
0810 01:42:14.794671 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:14.794710 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:14.794823 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:14.795521 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:14.795527 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:14.795553 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:14.795710 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.795720 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.797286 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.797290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.798715 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.798726 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.799750 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.799754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.799889 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.799936 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 01:42:14.800042 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 01:42:14.800224 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":69,"thread_start_us":77,"threads_started":1}
I20260810 01:42:14.800405 23622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.794542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49722 (local address 127.16.58.66:39095)
0810 01:42:14.795005 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.795017 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.795041 (+ 24us) server_negotiation.cc:407] Connection header received
0810 01:42:14.795122 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.795127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.795337 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.795902 (+ 565us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:14.796061 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.797151 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.798843 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.799626 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.799738 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.799904 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.800083 (+ 179us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.800250 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":131,"threads_started":1}
I20260810 01:42:14.800366 23623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.795058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:38759 (local address 127.0.0.1:46130)
0810 01:42:14.795378 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:14.795390 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:14.795470 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:14.796576 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:14.796579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:14.796596 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:14.796700 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.796707 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.797878 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.797881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.798889 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.798901 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.799895 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.799899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.799973 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.799992 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:42:14.800045 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 01:42:14.800209 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":89,"thread_start_us":103,"threads_started":1}
I20260810 01:42:14.800951 23624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.795368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:46243 (local address 127.0.0.1:58624)
0810 01:42:14.795581 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:14.795593 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:14.795662 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:14.796815 (+ 1153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:14.796816 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:14.796831 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:14.796891 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.796894 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.798213 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.798217 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.799349 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.799360 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.800590 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.800593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.800667 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.800686 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:42:14.800755 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:42:14.800823 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":25,"thread_start_us":89,"threads_started":1}
I20260810 01:42:14.801129 23628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.795779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46130 (local address 127.16.58.67:38759)
0810 01:42:14.796160 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.796171 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.796192 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:42:14.796258 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.796262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.796433 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.796580 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:14.796809 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.797739 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.799014 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.799744 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.800469 (+ 725us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.800611 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.800669 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.800981 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":142,"threads_started":1}
I20260810 01:42:14.801630 23629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.795945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58624 (local address 127.16.58.65:46243)
0810 01:42:14.796227 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.796232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.796251 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:42:14.796311 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.796315 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.796447 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.796575 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:14.796987 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.798052 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.799453 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.800412 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.801205 (+ 793us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.801340 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.801386 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.801467 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":67,"threads_started":1}
I20260810 01:42:14.803665 23502 tablet_service.cc:1467] Processing CreateTablet for tablet b1eeb6639eb3440ab45f2dc1aeccdada (DEFAULT_TABLE table=test-table [id=4bca891abc81441c8dc536c853218e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:14.803848 23311 tablet_service.cc:1467] Processing CreateTablet for tablet b1eeb6639eb3440ab45f2dc1aeccdada (DEFAULT_TABLE table=test-table [id=4bca891abc81441c8dc536c853218e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:14.804297 23115 tablet_service.cc:1467] Processing CreateTablet for tablet b1eeb6639eb3440ab45f2dc1aeccdada (DEFAULT_TABLE table=test-table [id=4bca891abc81441c8dc536c853218e8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:14.804701 23502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1eeb6639eb3440ab45f2dc1aeccdada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:14.804886 23311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1eeb6639eb3440ab45f2dc1aeccdada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:14.805233 23115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1eeb6639eb3440ab45f2dc1aeccdada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:14.810999 23630 tablet_bootstrap.cc:492] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27: Bootstrap starting.
I20260810 01:42:14.812485 23632 tablet_bootstrap.cc:492] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958: Bootstrap starting.
I20260810 01:42:14.813135 23630 tablet_bootstrap.cc:654] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:14.814229 23630 log.cc:824] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:14.814569 23632 tablet_bootstrap.cc:654] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:14.815280 23632 log.cc:824] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:14.815989 23631 tablet_bootstrap.cc:492] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857: Bootstrap starting.
I20260810 01:42:14.816135 23630 tablet_bootstrap.cc:492] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27: No bootstrap required, opened a new log
I20260810 01:42:14.816329 23630 ts_tablet_manager.cc:1397] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20260810 01:42:14.817232 23632 tablet_bootstrap.cc:492] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958: No bootstrap required, opened a new log
I20260810 01:42:14.817409 23632 ts_tablet_manager.cc:1397] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:42:14.818077 23631 tablet_bootstrap.cc:654] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:14.819262 23631 log.cc:824] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:14.819203 23630 raft_consensus.cc:348] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } }
I20260810 01:42:14.819460 23630 raft_consensus.cc:374] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:14.819532 23630 raft_consensus.cc:729] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1931d26c1c904c35918a9cb40fb88c27, State: Initialized, Role: FOLLOWER
I20260810 01:42:14.820019 23630 consensus_queue.cc:260] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } }
I20260810 01:42:14.820963 23603 heartbeater.cc:503] Master 127.16.58.126:43237 was elected leader, sending a full tablet report...
I20260810 01:42:14.821137 23630 ts_tablet_manager.cc:1428] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
I20260810 01:42:14.821265 23631 tablet_bootstrap.cc:492] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857: No bootstrap required, opened a new log
I20260810 01:42:14.821427 23631 ts_tablet_manager.cc:1397] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:42:14.821388 23632 raft_consensus.cc:348] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } }
I20260810 01:42:14.821658 23632 raft_consensus.cc:374] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:14.821768 23632 raft_consensus.cc:729] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adf7c3a6d21a4ff6bdc636d4ca28a958, State: Initialized, Role: FOLLOWER
I20260810 01:42:14.822154 23632 consensus_queue.cc:260] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } }
I20260810 01:42:14.822789 23407 heartbeater.cc:503] Master 127.16.58.126:43237 was elected leader, sending a full tablet report...
I20260810 01:42:14.823151 23632 ts_tablet_manager.cc:1428] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:42:14.825024 23631 raft_consensus.cc:348] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } }
I20260810 01:42:14.825268 23631 raft_consensus.cc:374] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:14.825373 23631 raft_consensus.cc:729] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85036993f52a4579b1489d7afb0da857, State: Initialized, Role: FOLLOWER
I20260810 01:42:14.825819 23631 consensus_queue.cc:260] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } }
I20260810 01:42:14.826442 23201 heartbeater.cc:503] Master 127.16.58.126:43237 was elected leader, sending a full tablet report...
I20260810 01:42:14.826946 23631 ts_tablet_manager.cc:1428] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260810 01:42:14.828939 23202 tablet.cc:2369] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:14.887116 23641 raft_consensus.cc:482] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:14.887356 23641 raft_consensus.cc:504] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } }
I20260810 01:42:14.888729 23641 leader_election.cc:288] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adf7c3a6d21a4ff6bdc636d4ca28a958 (127.16.58.66:39095), 1931d26c1c904c35918a9cb40fb88c27 (127.16.58.67:38759)
I20260810 01:42:14.894023 23622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.889038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:59385 (local address 127.16.58.66:39095)
0810 01:42:14.889181 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.889185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.889324 (+ 139us) server_negotiation.cc:407] Connection header received
0810 01:42:14.889593 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.889596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.889648 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.889696 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:14.890126 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.890924 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.892775 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.893398 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.893518 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.893570 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.893822 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.893890 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:42:14.894023 23628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.889459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:57169 (local address 127.16.58.67:38759)
0810 01:42:14.889642 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:14.889646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:14.889744 (+ 98us) server_negotiation.cc:407] Connection header received
0810 01:42:14.889873 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:14.889876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:14.889920 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:14.889990 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:14.890274 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.890999 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.892776 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.893398 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.893518 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.893570 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:14.893822 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 01:42:14.893890 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 01:42:14.894079 23642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.888926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:39095 (local address 127.16.58.65:59385)
0810 01:42:14.889246 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:14.889261 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:14.889452 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:14.889842 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:14.889845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:14.889865 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:14.889999 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.890005 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.891047 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.891051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.892658 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.892669 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.893508 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.893511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.893626 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.893716 (+ 90us) client_negotiation.cc:769] Sending connection context
0810 01:42:14.893786 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:42:14.893906 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":181,"thread_start_us":108,"threads_started":1}
I20260810 01:42:14.894083 23646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:14.889324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:38759 (local address 127.16.58.65:57169)
0810 01:42:14.889651 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:14.889666 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:14.889778 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:14.890007 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:14.890010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:14.890026 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:14.890165 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.890171 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.891087 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.891090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.892664 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:14.892670 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:14.893508 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:14.893511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:14.893664 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:14.893717 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 01:42:14.893786 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:42:14.893905 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":197,"thread_start_us":106,"threads_started":1}
I20260810 01:42:14.894733 23339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1eeb6639eb3440ab45f2dc1aeccdada" candidate_uuid: "85036993f52a4579b1489d7afb0da857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" is_pre_election: true
I20260810 01:42:14.894737 23537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1eeb6639eb3440ab45f2dc1aeccdada" candidate_uuid: "85036993f52a4579b1489d7afb0da857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1931d26c1c904c35918a9cb40fb88c27" is_pre_election: true
I20260810 01:42:14.895009 23537 raft_consensus.cc:2454] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85036993f52a4579b1489d7afb0da857 in term 0.
I20260810 01:42:14.895013 23339 raft_consensus.cc:2454] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85036993f52a4579b1489d7afb0da857 in term 0.
I20260810 01:42:14.895437 23047 leader_election.cc:302] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1931d26c1c904c35918a9cb40fb88c27, 85036993f52a4579b1489d7afb0da857; no voters:
I20260810 01:42:14.895682 23641 raft_consensus.cc:2781] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:14.895761 23641 raft_consensus.cc:482] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:14.895790 23641 raft_consensus.cc:3037] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:14.988042 23641 raft_consensus.cc:504] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } }
I20260810 01:42:14.988555 23641 leader_election.cc:288] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [CANDIDATE]: Term 1 election: Requested vote from peers adf7c3a6d21a4ff6bdc636d4ca28a958 (127.16.58.66:39095), 1931d26c1c904c35918a9cb40fb88c27 (127.16.58.67:38759)
I20260810 01:42:14.989060 23339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1eeb6639eb3440ab45f2dc1aeccdada" candidate_uuid: "85036993f52a4579b1489d7afb0da857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958"
I20260810 01:42:14.989113 23537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1eeb6639eb3440ab45f2dc1aeccdada" candidate_uuid: "85036993f52a4579b1489d7afb0da857" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1931d26c1c904c35918a9cb40fb88c27"
I20260810 01:42:14.989241 23537 raft_consensus.cc:3037] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:14.989241 23339 raft_consensus.cc:3037] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:14.990710 23339 raft_consensus.cc:2454] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85036993f52a4579b1489d7afb0da857 in term 1.
I20260810 01:42:14.990939 23537 raft_consensus.cc:2454] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85036993f52a4579b1489d7afb0da857 in term 1.
I20260810 01:42:14.991102 23047 leader_election.cc:302] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85036993f52a4579b1489d7afb0da857, adf7c3a6d21a4ff6bdc636d4ca28a958; no voters:
I20260810 01:42:14.991343 23641 raft_consensus.cc:2781] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:14.991626 23641 raft_consensus.cc:686] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [term 1 LEADER]: Becoming Leader. State: Replica: 85036993f52a4579b1489d7afb0da857, State: Running, Role: LEADER
I20260810 01:42:14.992057 23641 consensus_queue.cc:237] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } }
I20260810 01:42:14.995609 22930 catalog_manager.cc:5495] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85036993f52a4579b1489d7afb0da857 (127.16.58.65). New cstate: current_term: 1 leader_uuid: "85036993f52a4579b1489d7afb0da857" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85036993f52a4579b1489d7afb0da857" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46243 } health_report { overall_health: HEALTHY } } }
W20260810 01:42:15.001480 23604 tablet.cc:2369] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:42:15.027952 23410 tablet.cc:2369] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:15.041085 23629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.037941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58640 (local address 127.16.58.65:46243)
0810 01:42:15.038059 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:15.038063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:15.038076 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:15.038175 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:15.038177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:15.038232 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:15.038318 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:15.038500 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:15.039026 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:15.039834 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:15.040049 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:15.040128 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:15.040363 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:15.040757 (+ 394us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:15.040839 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:15.040925 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 01:42:15.040973 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:42:15.046780 23339 raft_consensus.cc:1261] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [term 1 FOLLOWER]: Refusing update from remote peer 85036993f52a4579b1489d7afb0da857: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:15.046780 23537 raft_consensus.cc:1261] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [term 1 FOLLOWER]: Refusing update from remote peer 85036993f52a4579b1489d7afb0da857: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:15.047468 23641 consensus_queue.cc:1035] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adf7c3a6d21a4ff6bdc636d4ca28a958" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:15.047675 23647 consensus_queue.cc:1035] T b1eeb6639eb3440ab45f2dc1aeccdada P 85036993f52a4579b1489d7afb0da857 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1931d26c1c904c35918a9cb40fb88c27" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:15.056581 23657 mvcc.cc:205] Tried to move back new op lower bound from 7316791849144463360 to 7316791848930533376. Current Snapshot: MvccSnapshot[applied={T|T < 7316791849144463360}]
I20260810 01:42:15.063728 22929 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:15.063905 22929 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:15.066205 22929 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63cca2234cb84ef6a309b66a18ab784f: Sending DeleteTablet for 3 replicas of tablet b1eeb6639eb3440ab45f2dc1aeccdada
I20260810 01:42:15.066852 23311 tablet_service.cc:1514] Processing DeleteTablet for tablet b1eeb6639eb3440ab45f2dc1aeccdada with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:15 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:49722
I20260810 01:42:15.066927 23502 tablet_service.cc:1514] Processing DeleteTablet for tablet b1eeb6639eb3440ab45f2dc1aeccdada with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:15 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:46130
I20260810 01:42:15.067358 23668 tablet_replica.cc:330] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958: stopping tablet replica
I20260810 01:42:15.067346 23115 tablet_service.cc:1514] Processing DeleteTablet for tablet b1eeb6639eb3440ab45f2dc1aeccdada with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:15 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:58624
I20260810 01:42:15.067597 23669 tablet_replica.cc:330] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27: stopping tablet replica
I20260810 01:42:15.067921 23669 raft_consensus.cc:2229] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:15.067946 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 23022
I20260810 01:42:15.068210 23669 raft_consensus.cc:2258] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:15.070501 23668 raft_consensus.cc:2229] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:15.070710 23668 raft_consensus.cc:2258] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:15.075117 23668 ts_tablet_manager.cc:1905] T b1eeb6639eb3440ab45f2dc1aeccdada P adf7c3a6d21a4ff6bdc636d4ca28a958: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:15.079025 23669 ts_tablet_manager.cc:1905] T b1eeb6639eb3440ab45f2dc1aeccdada P 1931d26c1c904c35918a9cb40fb88c27: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 01:42:15.085369 22910 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:46243 (error 108)
I20260810 01:42:15.086113 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 23212
I20260810 01:42:15.090305 23624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.086821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:46243 (local address 127.0.0.1:58650)
0810 01:42:15.090167 (+ 3346us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:15.090232 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:46243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3257}
W20260810 01:42:15.090617 22910 catalog_manager.cc:4584] TS 85036993f52a4579b1489d7afb0da857 (127.16.58.65:46243): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b1eeb6639eb3440ab45f2dc1aeccdada: Network error: Client connection negotiation failed: client connection to 127.16.58.65:46243: connect: Connection refused (error 111)
I20260810 01:42:15.103504 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 23414
I20260810 01:42:15.103909 23624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.103592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:39095 (local address 127.0.0.1:49736)
0810 01:42:15.103763 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:15.103831 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.66:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260810 01:42:15.122960 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 22886
2026-08-10T01:42:15Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2464 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T01:42:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:15Z Disabled control of system clock
I20260810 01:42:15.162533 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:45325
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:44941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:45325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 01:42:15.268791 23676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:15.269021 23676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:15.269054 23676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:15.272888 23676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:15.272935 23676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:15.272949 23676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:15.272964 23676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:15.272981 23676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:15.277484 23676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:45325
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:45325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:15.278363 23676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:15.279556 23676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:15.287612 23683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:15.287624 23689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:15.287662 23687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:15.288075 23676 server_base.cc:1034] running on GCE node
I20260810 01:42:15.288607 23676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:15.289620 23676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:15.290776 23676 hybrid_clock.cc:648] HybridClock initialized: now 1786326135290755 us; error 34 us; skew 500 ppm
I20260810 01:42:15.292527 23676 webserver.cc:460] Webserver started at http://127.16.58.126:43951/ using document root <none> and password file <none>
I20260810 01:42:15.293047 23676 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:15.293107 23676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:15.293293 23676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:15.295185 23676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "cbdf437b67a64a3d9d64cd5a949f3b49"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "96107008d9c7e01469ff5b7db99be1ff"
server_key_iv: "a1365101f109c11e90123d655f7df7b6"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.295707 23676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "cbdf437b67a64a3d9d64cd5a949f3b49"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "96107008d9c7e01469ff5b7db99be1ff"
server_key_iv: "a1365101f109c11e90123d655f7df7b6"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.299124 23676 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:42:15.301388 23697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.302565 23676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:15.302695 23676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "cbdf437b67a64a3d9d64cd5a949f3b49"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "96107008d9c7e01469ff5b7db99be1ff"
server_key_iv: "a1365101f109c11e90123d655f7df7b6"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.302789 23676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:15.307077 23676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:15.307644 23676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:15.307796 23676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:15.314271 23676 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:45325
I20260810 01:42:15.314281 23773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:45325 every 8 connection(s)
I20260810 01:42:15.315115 23676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:15.317317 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 23676
I20260810 01:42:15.317417 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:15.317662 16617 external_mini_cluster.cc:1428] Setting key bc3a5a22f3edca3e43d5715793b1cbd5
I20260810 01:42:15.318331 23774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:15.323611 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.319791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37636 (local address 127.16.58.126:45325)
0810 01:42:15.320415 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:15.320428 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:15.320461 (+ 33us) server_negotiation.cc:407] Connection header received
0810 01:42:15.321078 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:15.321093 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:15.321403 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:15.321695 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:15.322438 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:15.322443 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:15.322454 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:15.322465 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:15.322517 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:15.322532 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:15.322664 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:15.322732 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 01:42:15.322954 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":121,"threads_started":1}
I20260810 01:42:15.324892 23774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49: Bootstrap starting.
I20260810 01:42:15.327014 23774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:15.327701 23774 log.cc:824] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:15.329497 23774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49: No bootstrap required, opened a new log
I20260810 01:42:15.332957 23774 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf437b67a64a3d9d64cd5a949f3b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45325 } }
I20260810 01:42:15.333174 23774 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:15.333235 23774 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbdf437b67a64a3d9d64cd5a949f3b49, State: Initialized, Role: FOLLOWER
I20260810 01:42:15.333636 23774 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf437b67a64a3d9d64cd5a949f3b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45325 } }
I20260810 01:42:15.333775 23774 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:15.333841 23774 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:15.333940 23774 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:15.391448 23774 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf437b67a64a3d9d64cd5a949f3b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45325 } }
I20260810 01:42:15.392036 23774 leader_election.cc:302] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbdf437b67a64a3d9d64cd5a949f3b49; no voters:
I20260810 01:42:15.392434 23774 leader_election.cc:288] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:15.392553 23783 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:15.392840 23783 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [term 1 LEADER]: Becoming Leader. State: Replica: cbdf437b67a64a3d9d64cd5a949f3b49, State: Running, Role: LEADER
I20260810 01:42:15.393240 23783 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf437b67a64a3d9d64cd5a949f3b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45325 } }
I20260810 01:42:15.393855 23774 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:15.394797 23785 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbdf437b67a64a3d9d64cd5a949f3b49. Latest consensus state: current_term: 1 leader_uuid: "cbdf437b67a64a3d9d64cd5a949f3b49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf437b67a64a3d9d64cd5a949f3b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45325 } } }
I20260810 01:42:15.394932 23785 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:15.395211 23784 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbdf437b67a64a3d9d64cd5a949f3b49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbdf437b67a64a3d9d64cd5a949f3b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45325 } } }
I20260810 01:42:15.395316 23784 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:15.395350 23792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:15.398530 23792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:15.403793 23792 catalog_manager.cc:1347] Generated new cluster ID: 4f1745b38fa84ffd92acfed44aebba55
I20260810 01:42:15.403878 23792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:15.419927 23792 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:15.420205 23792 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:15.432394 23792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49: Generated new TSK 0
I20260810 01:42:15.432979 23792 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:42:15.453998 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45325
--builtin_ntp_servers=127.16.58.84:44941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 01:42:15.585924 23805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:15.586167 23805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:15.586221 23805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:15.590430 23805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:15.590493 23805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:15.590567 23805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:15.595660 23805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:15.596601 23805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:15.597882 23805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:15.606925 23820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:15.606909 23813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:15.606899 23814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:15.606979 23805 server_base.cc:1034] running on GCE node
I20260810 01:42:15.607508 23805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:15.608114 23805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:15.609272 23805 hybrid_clock.cc:648] HybridClock initialized: now 1786326135609255 us; error 28 us; skew 500 ppm
I20260810 01:42:15.610940 23805 webserver.cc:460] Webserver started at http://127.16.58.65:41283/ using document root <none> and password file <none>
I20260810 01:42:15.611506 23805 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:15.611574 23805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:15.611776 23805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:15.613698 23805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "a1815c9f15bc441aa1e91e8bbf6e0448"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "d428a8735bc261ba39bcaa0571ad8793"
server_key_iv: "43b3da50215df5fd7633a147bb922b53"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.614204 23805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "a1815c9f15bc441aa1e91e8bbf6e0448"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "d428a8735bc261ba39bcaa0571ad8793"
server_key_iv: "43b3da50215df5fd7633a147bb922b53"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.617563 23805 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260810 01:42:15.619766 23828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.620872 23805 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:15.620976 23805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "a1815c9f15bc441aa1e91e8bbf6e0448"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "d428a8735bc261ba39bcaa0571ad8793"
server_key_iv: "43b3da50215df5fd7633a147bb922b53"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.621068 23805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:15.625345 23805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:15.625895 23805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:15.626048 23805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:15.626572 23805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:15.627503 23805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:15.627550 23805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.627599 23805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:15.627635 23805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.635751 23805 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:37769
I20260810 01:42:15.635779 23992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:37769 every 8 connection(s)
I20260810 01:42:15.636550 23805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:15.641709 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 23805
I20260810 01:42:15.641819 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:15.642076 16617 external_mini_cluster.cc:1428] Setting key fe02825971e84b901396802f5b87adb9
I20260810 01:42:15.642174 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.638182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:58625 (local address 127.16.58.126:45325)
0810 01:42:15.638300 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:15.638304 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:15.639249 (+ 945us) server_negotiation.cc:407] Connection header received
0810 01:42:15.640651 (+ 1402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:15.640654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:15.640703 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:15.640778 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:15.641740 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:15.641744 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:15.641747 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:15.641763 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:15.641787 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:15.641797 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:15.641877 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:15.641995 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 01:42:15.642040 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:42:15.643019 23997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.638501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:45325 (local address 127.16.58.65:58625)
0810 01:42:15.639104 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:15.639148 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:15.640445 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:15.640935 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:15.640941 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:15.641022 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:15.641482 (+ 460us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:15.641483 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:15.641536 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:15.641600 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:15.641861 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:15.641871 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:15.641876 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:42:15.642028 (+ 152us) client_negotiation.cc:240] Negotiation successful
0810 01:42:15.642264 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":107,"threads_started":1}
I20260810 01:42:15.644219 23993 heartbeater.cc:347] Connected to a master server at 127.16.58.126:45325
I20260810 01:42:15.644438 23993 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:15.644696 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45325
--builtin_ntp_servers=127.16.58.84:44941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 01:42:15.644877 23993 heartbeater.cc:511] Master 127.16.58.126:45325 requested a full tablet report, sending...
I20260810 01:42:15.646308 23722 ts_manager.cc:194] Registered new tserver with Master: a1815c9f15bc441aa1e91e8bbf6e0448 (127.16.58.65:37769)
W20260810 01:42:15.758292 23998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:15.758517 23998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:15.758558 23998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:15.763127 23998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:15.763177 23998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:15.763240 23998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:15.767870 23998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:15.769064 23998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:15.770450 23998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:15.779654 24005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:15.779650 24010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:15.779654 24013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:15.779966 23998 server_base.cc:1034] running on GCE node
I20260810 01:42:15.780339 23998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:15.780987 23998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:15.782143 23998 hybrid_clock.cc:648] HybridClock initialized: now 1786326135782127 us; error 34 us; skew 500 ppm
I20260810 01:42:15.783964 23998 webserver.cc:460] Webserver started at http://127.16.58.66:46025/ using document root <none> and password file <none>
I20260810 01:42:15.784488 23998 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:15.784551 23998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:15.784750 23998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:15.786726 23998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "d91ca66307994290844b30d2a278e0d9"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "6ce4979a8675894d9a60f104f0f3650c"
server_key_iv: "5e4714e57e5b93878ed961d0984fc5bf"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.787251 23998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "d91ca66307994290844b30d2a278e0d9"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "6ce4979a8675894d9a60f104f0f3650c"
server_key_iv: "5e4714e57e5b93878ed961d0984fc5bf"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.790843 23998 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260810 01:42:15.793815 24027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.795013 23998 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:15.795120 23998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "d91ca66307994290844b30d2a278e0d9"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "6ce4979a8675894d9a60f104f0f3650c"
server_key_iv: "5e4714e57e5b93878ed961d0984fc5bf"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.795213 23998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:15.799566 23998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:15.800243 23998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:15.800401 23998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:15.800935 23998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:15.801832 23998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:15.801880 23998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.801915 23998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:15.801935 23998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.815757 23998 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:42689
I20260810 01:42:15.815794 24198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:42689 every 8 connection(s)
I20260810 01:42:15.816876 23998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:15.822438 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.818573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:36117 (local address 127.16.58.126:45325)
0810 01:42:15.818712 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:15.818716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:15.819759 (+ 1043us) server_negotiation.cc:407] Connection header received
0810 01:42:15.821033 (+ 1274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:15.821036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:15.821089 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:15.821166 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:15.822080 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:15.822083 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:15.822085 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:15.822096 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:15.822115 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:15.822124 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:15.822196 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:15.822282 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 01:42:15.822327 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:42:15.823316 24202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.818959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:45325 (local address 127.16.58.66:36117)
0810 01:42:15.819609 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:15.819657 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:15.820852 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:15.821302 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:15.821308 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:15.821388 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:15.821850 (+ 462us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:15.821851 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:15.821890 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:15.821954 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:15.822187 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:15.822192 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:15.822195 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 01:42:15.822313 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 01:42:15.822498 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":132,"threads_started":1}
I20260810 01:42:15.824061 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 23998
I20260810 01:42:15.824182 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:15.824431 16617 external_mini_cluster.cc:1428] Setting key 46cebdb0ac5fa367b04adb2edad94f26
I20260810 01:42:15.824456 24199 heartbeater.cc:347] Connected to a master server at 127.16.58.126:45325
I20260810 01:42:15.824690 24199 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:15.825115 24199 heartbeater.cc:511] Master 127.16.58.126:45325 requested a full tablet report, sending...
I20260810 01:42:15.826151 23722 ts_manager.cc:194] Registered new tserver with Master: d91ca66307994290844b30d2a278e0d9 (127.16.58.66:42689)
I20260810 01:42:15.826299 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45325
--builtin_ntp_servers=127.16.58.84:44941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 01:42:15.939528 24204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:15.939760 24204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:15.939795 24204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:15.943727 24204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:15.943775 24204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:15.943857 24204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:15.948448 24204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:15.949331 24204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:15.950598 24204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:15.959620 24215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:15.959611 24214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:15.959877 24204 server_base.cc:1034] running on GCE node
W20260810 01:42:15.960072 24220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:15.960427 24204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:15.960978 24204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:15.962139 24204 hybrid_clock.cc:648] HybridClock initialized: now 1786326135962118 us; error 27 us; skew 500 ppm
I20260810 01:42:15.963758 24204 webserver.cc:460] Webserver started at http://127.16.58.67:37373/ using document root <none> and password file <none>
I20260810 01:42:15.964294 24204 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:15.964360 24204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:15.964536 24204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:15.966372 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "f8e3e5e3ea224d4eb336bfaaf521692e"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "9271e78188650fdfeeeafb26ef8e221b"
server_key_iv: "5c0ebd3fc7d8a894a97224da06f5ea64"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.966874 24204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "f8e3e5e3ea224d4eb336bfaaf521692e"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "9271e78188650fdfeeeafb26ef8e221b"
server_key_iv: "5c0ebd3fc7d8a894a97224da06f5ea64"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.970325 24204 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260810 01:42:15.972688 24227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.973742 24204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:15.973845 24204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "f8e3e5e3ea224d4eb336bfaaf521692e"
format_stamp: "Formatted at 2026-08-10 01:42:15 on dist-test-slave-jlzn"
server_key: "9271e78188650fdfeeeafb26ef8e221b"
server_key_iv: "5c0ebd3fc7d8a894a97224da06f5ea64"
server_key_version: "encryptionkey@0"
I20260810 01:42:15.973934 24204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:15.978312 24204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:15.978834 24204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:15.978982 24204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:15.979465 24204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:15.980314 24204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:15.980360 24204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.980409 24204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:15.980435 24204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:15.988139 24204 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:34729
I20260810 01:42:15.988162 24395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:34729 every 8 connection(s)
I20260810 01:42:15.988888 24204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:15.992795 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 24204
I20260810 01:42:15.992905 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:15.993161 16617 external_mini_cluster.cc:1428] Setting key b85bcdaba24f25f5c4c0d10cc5a40831
I20260810 01:42:15.994796 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.990454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:40959 (local address 127.16.58.126:45325)
0810 01:42:15.990573 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:15.990577 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:15.991512 (+ 935us) server_negotiation.cc:407] Connection header received
0810 01:42:15.992926 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:15.992930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:15.992997 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:15.993046 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:15.994354 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:15.994358 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:15.994360 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:15.994373 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:15.994399 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:15.994408 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:15.994490 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:15.994653 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 01:42:15.994693 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:42:15.997057 24400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:15.990763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:45325 (local address 127.16.58.67:40959)
0810 01:42:15.991369 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:15.991405 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:15.992691 (+ 1286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:15.993389 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:15.993396 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:15.993501 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:15.994072 (+ 571us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:15.994075 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:15.994126 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:15.994220 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:15.994499 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:15.994508 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:15.994515 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 01:42:15.995341 (+ 826us) client_negotiation.cc:240] Negotiation successful
0810 01:42:15.995631 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":119,"threads_started":1}
I20260810 01:42:15.998010 24396 heartbeater.cc:347] Connected to a master server at 127.16.58.126:45325
I20260810 01:42:15.998216 24396 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:15.998560 24396 heartbeater.cc:511] Master 127.16.58.126:45325 requested a full tablet report, sending...
I20260810 01:42:15.999432 23722 ts_manager.cc:194] Registered new tserver with Master: f8e3e5e3ea224d4eb336bfaaf521692e (127.16.58.67:34729)
I20260810 01:42:16.006863 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:42:16.009887 23779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.008666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37644 (local address 127.16.58.126:45325)
0810 01:42:16.008759 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.008762 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.008954 (+ 192us) server_negotiation.cc:407] Connection header received
0810 01:42:16.009039 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.009041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.009069 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.009126 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:16.009638 (+ 512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:16.009641 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:16.009642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:16.009652 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:16.009668 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:16.009675 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:16.009733 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:16.009772 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 01:42:16.009800 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 01:42:16.012233 23722 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37644:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:16.015071 23722 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:16.025377 24413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.022528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50638 (local address 127.16.58.67:34729)
0810 01:42:16.022852 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.022863 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.023335 (+ 472us) server_negotiation.cc:407] Connection header received
0810 01:42:16.023389 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.023394 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.023576 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.024162 (+ 586us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:16.024781 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:16.024786 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:16.024797 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:16.024806 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:16.024841 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:16.024864 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:16.024975 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:16.025158 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 01:42:16.025235 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":142,"threads_started":1}
I20260810 01:42:16.025719 24414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.022419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:34729 (local address 127.0.0.1:50638)
0810 01:42:16.023087 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.023139 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:16.023241 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:16.023719 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:16.023724 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:16.023792 (+ 68us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:16.024344 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:16.024346 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:16.024366 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:16.024455 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:16.024966 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:16.024975 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:16.024982 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 01:42:16.025096 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 01:42:16.025169 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"spinlock_wait_cycles":7680,"thread_start_us":66,"threads_started":1}
I20260810 01:42:16.025895 24415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.023021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54462 (local address 127.16.58.65:37769)
0810 01:42:16.023872 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.023884 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.023907 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:42:16.023958 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.023963 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.024128 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.024525 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:16.025263 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:16.025268 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:16.025277 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:16.025288 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:16.025323 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:16.025348 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:16.025646 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:16.025691 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 01:42:16.025757 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":159,"threads_started":1}
I20260810 01:42:16.025744 24412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.022563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:37769 (local address 127.0.0.1:54462)
0810 01:42:16.023087 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.023140 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:16.023241 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:16.024278 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:16.024281 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:16.024298 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:16.024684 (+ 386us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:16.024686 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:16.024696 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:16.024724 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:16.025453 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:16.025456 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:16.025460 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:42:16.025518 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 01:42:16.025552 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"spinlock_wait_cycles":18304,"thread_start_us":116,"threads_started":1}
I20260810 01:42:16.028517 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.023235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42689 (local address 127.0.0.1:50814)
0810 01:42:16.023469 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.023480 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:16.023546 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:16.025012 (+ 1466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:16.025015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:16.025029 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:16.025460 (+ 431us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:16.025462 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:16.025473 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:16.025500 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:16.028280 (+ 2780us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:16.028284 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:16.028288 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:42:16.028373 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 01:42:16.028407 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":95,"threads_started":1}
I20260810 01:42:16.028712 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.023630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50814 (local address 127.16.58.66:42689)
0810 01:42:16.024598 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.024611 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.024634 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:42:16.024685 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.024690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.024843 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.025265 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:16.028087 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:16.028092 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:16.028102 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:16.028112 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:16.028157 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:16.028181 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:16.028285 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:16.028381 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 01:42:16.028442 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":162,"threads_started":1}
I20260810 01:42:16.028609 23894 tablet_service.cc:1467] Processing CreateTablet for tablet befbc09857fd4db28e02984bfb6edbc3 (DEFAULT_TABLE table=test-table [id=e75498e7788a4129b6ef30225ad9f8d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:16.028610 24293 tablet_service.cc:1467] Processing CreateTablet for tablet befbc09857fd4db28e02984bfb6edbc3 (DEFAULT_TABLE table=test-table [id=e75498e7788a4129b6ef30225ad9f8d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:16.029657 24293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet befbc09857fd4db28e02984bfb6edbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:16.029664 23894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet befbc09857fd4db28e02984bfb6edbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:16.031275 24069 tablet_service.cc:1467] Processing CreateTablet for tablet befbc09857fd4db28e02984bfb6edbc3 (DEFAULT_TABLE table=test-table [id=e75498e7788a4129b6ef30225ad9f8d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:16.032217 24069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet befbc09857fd4db28e02984bfb6edbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:16.035568 24421 tablet_bootstrap.cc:492] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: Bootstrap starting.
I20260810 01:42:16.036933 24422 tablet_bootstrap.cc:492] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448: Bootstrap starting.
I20260810 01:42:16.037707 24421 tablet_bootstrap.cc:654] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:16.038543 24421 log.cc:824] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:16.038995 24422 tablet_bootstrap.cc:654] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:16.039391 24423 tablet_bootstrap.cc:492] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9: Bootstrap starting.
I20260810 01:42:16.039862 24422 log.cc:824] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:16.040539 24421 tablet_bootstrap.cc:492] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: No bootstrap required, opened a new log
I20260810 01:42:16.040730 24421 ts_tablet_manager.cc:1397] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:42:16.041203 24423 tablet_bootstrap.cc:654] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:16.041740 24422 tablet_bootstrap.cc:492] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448: No bootstrap required, opened a new log
I20260810 01:42:16.041878 24423 log.cc:824] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:16.041922 24422 ts_tablet_manager.cc:1397] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:42:16.043341 24423 tablet_bootstrap.cc:492] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9: No bootstrap required, opened a new log
I20260810 01:42:16.043510 24423 ts_tablet_manager.cc:1397] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 01:42:16.044970 24421 raft_consensus.cc:348] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } }
I20260810 01:42:16.045279 24421 raft_consensus.cc:374] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:16.045360 24421 raft_consensus.cc:729] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8e3e5e3ea224d4eb336bfaaf521692e, State: Initialized, Role: FOLLOWER
I20260810 01:42:16.045814 24421 consensus_queue.cc:260] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } }
I20260810 01:42:16.046074 24422 raft_consensus.cc:348] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } }
I20260810 01:42:16.046365 24422 raft_consensus.cc:374] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:16.046452 24422 raft_consensus.cc:729] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1815c9f15bc441aa1e91e8bbf6e0448, State: Initialized, Role: FOLLOWER
I20260810 01:42:16.046478 24396 heartbeater.cc:503] Master 127.16.58.126:45325 was elected leader, sending a full tablet report...
I20260810 01:42:16.046841 24421 ts_tablet_manager.cc:1428] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:42:16.046926 24422 consensus_queue.cc:260] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } }
I20260810 01:42:16.047250 24423 raft_consensus.cc:348] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } }
I20260810 01:42:16.047479 24423 raft_consensus.cc:374] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:16.047523 23993 heartbeater.cc:503] Master 127.16.58.126:45325 was elected leader, sending a full tablet report...
I20260810 01:42:16.047533 24423 raft_consensus.cc:729] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d91ca66307994290844b30d2a278e0d9, State: Initialized, Role: FOLLOWER
I20260810 01:42:16.047993 24422 ts_tablet_manager.cc:1428] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 01:42:16.047983 24423 consensus_queue.cc:260] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } }
I20260810 01:42:16.048666 24199 heartbeater.cc:503] Master 127.16.58.126:45325 was elected leader, sending a full tablet report...
I20260810 01:42:16.049597 24423 ts_tablet_manager.cc:1428] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:42:16.055015 24432 raft_consensus.cc:482] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:16.055142 24432 raft_consensus.cc:504] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } }
I20260810 01:42:16.056034 24432 leader_election.cc:288] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8e3e5e3ea224d4eb336bfaaf521692e (127.16.58.67:34729), d91ca66307994290844b30d2a278e0d9 (127.16.58.66:42689)
I20260810 01:42:16.057689 24413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.056431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:58507 (local address 127.16.58.67:34729)
0810 01:42:16.056540 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.056545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.056557 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:16.056590 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.056592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.056637 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.056707 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:16.057347 (+ 640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:16.057351 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:16.057354 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:16.057366 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:16.057385 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:16.057393 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:16.057469 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:16.057538 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 01:42:16.057576 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 01:42:16.057689 23997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.056193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:34729 (local address 127.16.58.65:58507)
0810 01:42:16.056312 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.056328 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:16.056396 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:16.056745 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:16.056748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:16.056763 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:16.057219 (+ 456us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:16.057220 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:16.057230 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:16.057253 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:16.057463 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:16.057466 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:16.057469 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 01:42:16.057539 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:42:16.057567 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 01:42:16.057824 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.056431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:48311 (local address 127.16.58.66:42689)
0810 01:42:16.056536 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.056539 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.056673 (+ 134us) server_negotiation.cc:407] Connection header received
0810 01:42:16.056754 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.056757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.056786 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.056865 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:16.057499 (+ 634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:16.057502 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:16.057505 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:16.057516 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:16.057534 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:16.057544 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:16.057620 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:16.057688 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 01:42:16.057723 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:42:16.057837 24434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.056244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42689 (local address 127.16.58.65:48311)
0810 01:42:16.056598 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.056610 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:16.056690 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:16.056878 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:16.056880 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:16.056891 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:16.057370 (+ 479us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:16.057372 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:16.057380 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:16.057399 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:16.057616 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:16.057619 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:16.057623 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:42:16.057689 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 01:42:16.057720 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":99,"threads_started":1}
I20260810 01:42:16.058302 24109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befbc09857fd4db28e02984bfb6edbc3" candidate_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d91ca66307994290844b30d2a278e0d9" is_pre_election: true
I20260810 01:42:16.058326 24329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befbc09857fd4db28e02984bfb6edbc3" candidate_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" is_pre_election: true
I20260810 01:42:16.058552 24109 raft_consensus.cc:2454] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1815c9f15bc441aa1e91e8bbf6e0448 in term 0.
I20260810 01:42:16.058566 24329 raft_consensus.cc:2454] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1815c9f15bc441aa1e91e8bbf6e0448 in term 0.
I20260810 01:42:16.058974 23829 leader_election.cc:302] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1815c9f15bc441aa1e91e8bbf6e0448, d91ca66307994290844b30d2a278e0d9; no voters:
I20260810 01:42:16.059217 24432 raft_consensus.cc:2781] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:16.059299 24432 raft_consensus.cc:482] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:16.059351 24432 raft_consensus.cc:3037] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 0 FOLLOWER]: Advancing to term 1
W20260810 01:42:16.067734 24200 tablet.cc:2369] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:16.091946 24432 raft_consensus.cc:504] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } }
I20260810 01:42:16.092351 24432 leader_election.cc:288] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [CANDIDATE]: Term 1 election: Requested vote from peers f8e3e5e3ea224d4eb336bfaaf521692e (127.16.58.67:34729), d91ca66307994290844b30d2a278e0d9 (127.16.58.66:42689)
I20260810 01:42:16.092669 24109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befbc09857fd4db28e02984bfb6edbc3" candidate_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d91ca66307994290844b30d2a278e0d9"
I20260810 01:42:16.092676 24329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "befbc09857fd4db28e02984bfb6edbc3" candidate_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e"
I20260810 01:42:16.092790 24329 raft_consensus.cc:3037] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:16.092787 24109 raft_consensus.cc:3037] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:16.093808 24109 raft_consensus.cc:2454] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1815c9f15bc441aa1e91e8bbf6e0448 in term 1.
I20260810 01:42:16.094007 24329 raft_consensus.cc:2454] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1815c9f15bc441aa1e91e8bbf6e0448 in term 1.
I20260810 01:42:16.094108 23829 leader_election.cc:302] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1815c9f15bc441aa1e91e8bbf6e0448, d91ca66307994290844b30d2a278e0d9; no voters:
I20260810 01:42:16.094336 24432 raft_consensus.cc:2781] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:16.094568 24432 raft_consensus.cc:686] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [term 1 LEADER]: Becoming Leader. State: Replica: a1815c9f15bc441aa1e91e8bbf6e0448, State: Running, Role: LEADER
I20260810 01:42:16.094900 24432 consensus_queue.cc:237] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } }
I20260810 01:42:16.099036 23722 catalog_manager.cc:5495] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1815c9f15bc441aa1e91e8bbf6e0448 (127.16.58.65). New cstate: current_term: 1 leader_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1815c9f15bc441aa1e91e8bbf6e0448" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 37769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 } health_report { overall_health: UNKNOWN } } }
I20260810 01:42:16.121166 24415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.119841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54476 (local address 127.16.58.65:37769)
0810 01:42:16.119955 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.119960 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.119993 (+ 33us) server_negotiation.cc:407] Connection header received
0810 01:42:16.120163 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.120165 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.120220 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.120283 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:16.120870 (+ 587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:16.120873 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:16.120875 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:16.120882 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:16.120895 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:16.120901 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:16.120960 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:16.121006 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 01:42:16.121035 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:42:16.126410 24109 raft_consensus.cc:1261] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [term 1 FOLLOWER]: Refusing update from remote peer a1815c9f15bc441aa1e91e8bbf6e0448: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:16.126982 24329 raft_consensus.cc:1261] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [term 1 FOLLOWER]: Refusing update from remote peer a1815c9f15bc441aa1e91e8bbf6e0448: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:16.127039 24435 consensus_queue.cc:1035] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d91ca66307994290844b30d2a278e0d9" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:16.127556 24435 consensus_queue.cc:1035] T befbc09857fd4db28e02984bfb6edbc3 P a1815c9f15bc441aa1e91e8bbf6e0448 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8e3e5e3ea224d4eb336bfaaf521692e" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 34729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:16.133541 24440 mvcc.cc:205] Tried to move back new op lower bound from 7316791853567717376 to 7316791853447405568. Current Snapshot: MvccSnapshot[applied={T|T < 7316791853567717376}]
I20260810 01:42:16.136224 24438 mvcc.cc:205] Tried to move back new op lower bound from 7316791853567717376 to 7316791853447405568. Current Snapshot: MvccSnapshot[applied={T|T < 7316791853567717376}]
I20260810 01:42:16.143059 23722 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:16.143201 23722 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:16.145294 23722 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cbdf437b67a64a3d9d64cd5a949f3b49: Sending DeleteTablet for 3 replicas of tablet befbc09857fd4db28e02984bfb6edbc3
I20260810 01:42:16.145947 24293 tablet_service.cc:1514] Processing DeleteTablet for tablet befbc09857fd4db28e02984bfb6edbc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:16 UTC) from {username='slave'} at 127.0.0.1:50638
I20260810 01:42:16.145994 23894 tablet_service.cc:1514] Processing DeleteTablet for tablet befbc09857fd4db28e02984bfb6edbc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:16 UTC) from {username='slave'} at 127.0.0.1:54462
I20260810 01:42:16.146066 24069 tablet_service.cc:1514] Processing DeleteTablet for tablet befbc09857fd4db28e02984bfb6edbc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:16 UTC) from {username='slave'} at 127.0.0.1:50814
I20260810 01:42:16.146430 24451 tablet_replica.cc:330] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: stopping tablet replica
I20260810 01:42:16.146521 24453 tablet_replica.cc:330] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9: stopping tablet replica
I20260810 01:42:16.146775 24451 raft_consensus.cc:2229] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:16.146863 24453 raft_consensus.cc:2229] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:16.147075 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 23805
I20260810 01:42:16.147106 24451 raft_consensus.cc:2258] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:16.147204 24453 raft_consensus.cc:2258] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:16.152745 24453 ts_tablet_manager.cc:1905] T befbc09857fd4db28e02984bfb6edbc3 P d91ca66307994290844b30d2a278e0d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:16.153192 24451 ts_tablet_manager.cc:1905] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:16.160280 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 23998
W20260810 01:42:16.160368 23700 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:37769 (error 108)
I20260810 01:42:16.168195 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.167923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:37769 (local address 127.0.0.1:54488)
0810 01:42:16.168046 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.168116 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:37769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 01:42:16.168356 23700 catalog_manager.cc:4584] TS a1815c9f15bc441aa1e91e8bbf6e0448 (127.16.58.65:37769): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet befbc09857fd4db28e02984bfb6edbc3: Network error: Client connection negotiation failed: client connection to 127.16.58.65:37769: connect: Connection refused (error 111)
I20260810 01:42:16.196436 24451 ts_tablet_manager.cc:1918] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:16.196557 24451 log.cc:1196] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/befbc09857fd4db28e02984bfb6edbc3
I20260810 01:42:16.196944 24451 ts_tablet_manager.cc:1939] T befbc09857fd4db28e02984bfb6edbc3 P f8e3e5e3ea224d4eb336bfaaf521692e: Deleting consensus metadata
I20260810 01:42:16.200866 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 24204
I20260810 01:42:16.203243 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.200969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42689 (local address 127.0.0.1:50818)
0810 01:42:16.203111 (+ 2142us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.203164 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.66:42689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2049}
I20260810 01:42:16.222008 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.221762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:37769 (local address 127.0.0.1:54494)
0810 01:42:16.221887 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.221936 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:37769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 01:42:16.222646 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.222469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:37769 (local address 127.0.0.1:54500)
0810 01:42:16.222547 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.222587 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:37769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 01:42:16.247870 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.247608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42689 (local address 127.0.0.1:50826)
0810 01:42:16.247730 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.247778 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.66:42689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 01:42:16.248420 24418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.248250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42689 (local address 127.0.0.1:50836)
0810 01:42:16.248325 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.248365 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.66:42689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 01:42:16.263264 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 23676
2026-08-10T01:42:16Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1135 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 01:42:16.290863 16617 mini_oidc.cc:152] Starting JWKS server
I20260810 01:42:16.292645 16617 webserver.cc:460] Webserver started at https://127.0.0.1:39487/ using document root <none> and password file <none>
I20260810 01:42:16.292872 16617 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 01:42:16.293150 16617 webserver.cc:460] Webserver started at http://127.0.0.1:40099/ using document root <none> and password file <none>
2026-08-10T01:42:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:16Z Disabled control of system clock
I20260810 01:42:16.302170 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38355
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:43225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:38355
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39487/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/testchainca.cert with env {}
W20260810 01:42:16.407488 24465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:16.407759 24465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:16.407861 24465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:16.411713 24465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:16.411763 24465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:16.411785 24465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:16.411824 24465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:16.411852 24465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 01:42:16.411882 24465 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 01:42:16.411902 24465 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39487/jwks.json
I20260810 01:42:16.416899 24465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:38355
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39487/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:16.417775 24465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:16.418669 24465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:16.426350 24478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:16.426379 24473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:16.426379 24475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:16.426600 24465 server_base.cc:1034] running on GCE node
I20260810 01:42:16.427181 24465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:16.428164 24465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:16.429314 24465 hybrid_clock.cc:648] HybridClock initialized: now 1786326136429296 us; error 29 us; skew 500 ppm
I20260810 01:42:16.430930 24465 webserver.cc:460] Webserver started at http://127.16.58.126:38045/ using document root <none> and password file <none>
I20260810 01:42:16.431422 24465 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:16.431483 24465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:16.431691 24465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:16.433568 24465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "c0edaa80e688432cb04eb4440cc53346"
format_stamp: "Formatted at 2026-08-10 01:42:16 on dist-test-slave-jlzn"
server_key: "0ec1d1d4848b17c35ae73721a96b3e7a"
server_key_iv: "36509ea4351ce4db84ccb76fb45b407f"
server_key_version: "encryptionkey@0"
I20260810 01:42:16.434092 24465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "c0edaa80e688432cb04eb4440cc53346"
format_stamp: "Formatted at 2026-08-10 01:42:16 on dist-test-slave-jlzn"
server_key: "0ec1d1d4848b17c35ae73721a96b3e7a"
server_key_iv: "36509ea4351ce4db84ccb76fb45b407f"
server_key_version: "encryptionkey@0"
I20260810 01:42:16.437374 24465 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:42:16.439462 24488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:16.440572 24465 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:16.440689 24465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "c0edaa80e688432cb04eb4440cc53346"
format_stamp: "Formatted at 2026-08-10 01:42:16 on dist-test-slave-jlzn"
server_key: "0ec1d1d4848b17c35ae73721a96b3e7a"
server_key_iv: "36509ea4351ce4db84ccb76fb45b407f"
server_key_version: "encryptionkey@0"
I20260810 01:42:16.440776 24465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:16.460378 24465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:16.461057 24465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:16.461233 24465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:16.467888 24465 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:38355
I20260810 01:42:16.467895 24563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:38355 every 8 connection(s)
I20260810 01:42:16.468809 24465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:16.472052 24565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:16.476714 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 24465
I20260810 01:42:16.476830 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:16.477074 16617 external_mini_cluster.cc:1428] Setting key 24ebfbfeaea13de970cd1d0b83411450
I20260810 01:42:16.477538 24565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346: Bootstrap starting.
I20260810 01:42:16.479746 24565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:16.480573 24565 log.cc:824] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:16.482565 24565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346: No bootstrap required, opened a new log
I20260810 01:42:16.485910 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.478372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54798 (local address 127.16.58.126:38355)
0810 01:42:16.478959 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.478972 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.479006 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:42:16.479607 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.479623 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.480033 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.480303 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:16.480627 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.481782 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.482929 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.483381 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.483492 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:16.484339 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:16.484344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:16.484356 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:16.484707 (+ 351us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:16.484761 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:16.484780 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:16.484851 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:16.484999 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 01:42:16.485248 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":113,"threads_started":1}
I20260810 01:42:16.486372 24565 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0edaa80e688432cb04eb4440cc53346" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38355 } }
I20260810 01:42:16.486580 24565 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:16.486637 24565 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0edaa80e688432cb04eb4440cc53346, State: Initialized, Role: FOLLOWER
I20260810 01:42:16.487085 24565 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0edaa80e688432cb04eb4440cc53346" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38355 } }
I20260810 01:42:16.487249 24565 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:16.487313 24565 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:16.487404 24565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:16.488386 24565 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0edaa80e688432cb04eb4440cc53346" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38355 } }
I20260810 01:42:16.488582 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:42:16.488727 24565 leader_election.cc:302] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0edaa80e688432cb04eb4440cc53346; no voters:
I20260810 01:42:16.489048 24565 leader_election.cc:288] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:16.489123 24573 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:16.489339 24573 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [term 1 LEADER]: Becoming Leader. State: Replica: c0edaa80e688432cb04eb4440cc53346, State: Running, Role: LEADER
I20260810 01:42:16.489701 24573 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0edaa80e688432cb04eb4440cc53346" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38355 } }
I20260810 01:42:16.490279 24565 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:16.491163 24575 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0edaa80e688432cb04eb4440cc53346. Latest consensus state: current_term: 1 leader_uuid: "c0edaa80e688432cb04eb4440cc53346" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0edaa80e688432cb04eb4440cc53346" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38355 } } }
I20260810 01:42:16.491290 24575 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:16.491605 24576 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0edaa80e688432cb04eb4440cc53346" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0edaa80e688432cb04eb4440cc53346" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38355 } } }
I20260810 01:42:16.491752 24585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:16.491762 24576 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:16.494357 24585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:16.498944 24585 catalog_manager.cc:1347] Generated new cluster ID: 7e53a7e183a54d8cb43a73a54bcf81b6
I20260810 01:42:16.499006 24585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:16.521081 24585 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:16.521869 24585 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:16.525228 24585 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0edaa80e688432cb04eb4440cc53346: Generated new TSK 0
I20260810 01:42:16.525918 24585 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 01:42:16.559680 24606 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 01:42:16.559778 24606 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 01:42:16.560233 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.536188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54806 (local address 127.16.58.126:38355)
0810 01:42:16.536345 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.536350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.536681 (+ 331us) server_negotiation.cc:407] Connection header received
0810 01:42:16.536871 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.536874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.536918 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.536992 (+ 74us) server_negotiation.cc:226] Negotiated authn=JWT
0810 01:42:16.537244 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.537758 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.538939 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.539150 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.539212 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:16.539529 (+ 317us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 01:42:16.559923 (+ 20394us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 01:42:16.560112 (+ 189us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54806: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":66}
W20260810 01:42:16.560297 24569 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54806: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260810 01:42:16.561705 24603 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:16.536090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38355 (local address 127.0.0.1:54806)
0810 01:42:16.536586 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.536602 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:16.536734 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:16.537026 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:16.537029 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:16.537037 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0810 01:42:16.537159 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:16.537165 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.537846 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.537849 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:16.538843 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:16.538853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.539239 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.539243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:16.539333 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:16.539383 (+ 50us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 01:42:16.560098 (+ 20715us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 01:42:16.560298 (+ 200us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.58.126:38355: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":240,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.16.58.126:38355: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39487/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 01:42:16.562376 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 24465
2026-08-10T01:42:16Z chronyd exiting
I20260810 01:42:16.614382 16617 test_util.cc:175] -----------------------------------------------
I20260810 01:42:16.614462 16617 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786326110151381-16617-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (325 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 01:42:16.615535 16617 mini_oidc.cc:152] Starting JWKS server
I20260810 01:42:16.616410 16617 webserver.cc:460] Webserver started at https://127.0.0.1:36567/ using document root <none> and password file <none>
I20260810 01:42:16.616501 16617 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 01:42:16.616750 16617 webserver.cc:460] Webserver started at http://127.0.0.1:43895/ using document root <none> and password file <none>
2026-08-10T01:42:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:16Z Disabled control of system clock
I20260810 01:42:16.626127 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39783
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:43551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:39783
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36567/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/testchainca.cert with env {}
W20260810 01:42:16.732705 24614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:16.732939 24614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:16.732975 24614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:16.736956 24614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:16.737006 24614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:16.737020 24614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:16.737038 24614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:16.737054 24614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 01:42:16.737072 24614 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 01:42:16.737084 24614 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36567/jwks.json
I20260810 01:42:16.742095 24614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:39783
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36567/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:16.742926 24614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:16.743794 24614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:16.751533 24623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:16.751565 24622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:16.751634 24614 server_base.cc:1034] running on GCE node
W20260810 01:42:16.751579 24625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:16.752305 24614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:16.753264 24614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:16.754426 24614 hybrid_clock.cc:648] HybridClock initialized: now 1786326136754404 us; error 31 us; skew 500 ppm
I20260810 01:42:16.756110 24614 webserver.cc:460] Webserver started at http://127.16.58.126:43163/ using document root <none> and password file <none>
I20260810 01:42:16.756611 24614 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:16.756673 24614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:16.756856 24614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:16.758694 24614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "5d2103a3114e4115a2f2b4a021167568"
format_stamp: "Formatted at 2026-08-10 01:42:16 on dist-test-slave-jlzn"
server_key: "e5b05b1a426a2cdd61535083464786d4"
server_key_iv: "0ae85d65b7b41802d37fd6b0322b2504"
server_key_version: "encryptionkey@0"
I20260810 01:42:16.759224 24614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "5d2103a3114e4115a2f2b4a021167568"
format_stamp: "Formatted at 2026-08-10 01:42:16 on dist-test-slave-jlzn"
server_key: "e5b05b1a426a2cdd61535083464786d4"
server_key_iv: "0ae85d65b7b41802d37fd6b0322b2504"
server_key_version: "encryptionkey@0"
I20260810 01:42:16.762650 24614 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:42:16.764844 24632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:16.765949 24614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:16.766062 24614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "5d2103a3114e4115a2f2b4a021167568"
format_stamp: "Formatted at 2026-08-10 01:42:16 on dist-test-slave-jlzn"
server_key: "e5b05b1a426a2cdd61535083464786d4"
server_key_iv: "0ae85d65b7b41802d37fd6b0322b2504"
server_key_version: "encryptionkey@0"
I20260810 01:42:16.766150 24614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:16.774513 24614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:16.775044 24614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:16.775193 24614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:16.781669 24614 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:39783
I20260810 01:42:16.781682 24720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:39783 every 8 connection(s)
I20260810 01:42:16.782537 24614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:16.785451 24721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:16.790432 24721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568: Bootstrap starting.
I20260810 01:42:16.791004 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 24614
I20260810 01:42:16.791132 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:16.791369 16617 external_mini_cluster.cc:1428] Setting key cf9a7130684006f74b797aa96c6dacfe
I20260810 01:42:16.792891 24721 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:16.793579 24721 log.cc:824] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:16.795491 24721 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568: No bootstrap required, opened a new log
I20260810 01:42:16.799402 24721 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2103a3114e4115a2f2b4a021167568" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39783 } }
I20260810 01:42:16.799597 24721 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:16.799654 24721 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d2103a3114e4115a2f2b4a021167568, State: Initialized, Role: FOLLOWER
I20260810 01:42:16.799777 24726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.792410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38430 (local address 127.16.58.126:39783)
0810 01:42:16.792969 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.792985 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.793026 (+ 41us) server_negotiation.cc:407] Connection header received
0810 01:42:16.793607 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.793631 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.794063 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.794402 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:16.794715 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.795648 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.796847 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.797293 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.797417 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:16.798181 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:16.798186 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:16.798197 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:16.798545 (+ 348us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:16.798597 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:16.798616 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:16.798693 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:16.798837 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 01:42:16.799077 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":103,"threads_started":1}
I20260810 01:42:16.800112 24721 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2103a3114e4115a2f2b4a021167568" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39783 } }
I20260810 01:42:16.800279 24721 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:16.800344 24721 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:16.800434 24721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:16.801245 24721 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2103a3114e4115a2f2b4a021167568" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39783 } }
I20260810 01:42:16.801576 24721 leader_election.cc:302] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d2103a3114e4115a2f2b4a021167568; no voters:
I20260810 01:42:16.801875 24721 leader_election.cc:288] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:16.801956 24729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:16.802412 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:42:16.802441 24729 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [term 1 LEADER]: Becoming Leader. State: Replica: 5d2103a3114e4115a2f2b4a021167568, State: Running, Role: LEADER
I20260810 01:42:16.802755 24729 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2103a3114e4115a2f2b4a021167568" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39783 } }
I20260810 01:42:16.803000 24721 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:16.804308 24731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d2103a3114e4115a2f2b4a021167568" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2103a3114e4115a2f2b4a021167568" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39783 } } }
I20260810 01:42:16.804435 24731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:16.804702 24732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d2103a3114e4115a2f2b4a021167568. Latest consensus state: current_term: 1 leader_uuid: "5d2103a3114e4115a2f2b4a021167568" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d2103a3114e4115a2f2b4a021167568" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39783 } } }
I20260810 01:42:16.804801 24732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568 [sys.catalog]: This master's current role is: LEADER
W20260810 01:42:16.807200 24754 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:42:16.807263 24754 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:42:16.807320 24750 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:16.808058 24750 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:16.813100 24750 catalog_manager.cc:1347] Generated new cluster ID: a2f28e2b8dd54083a8ad6d5e81b74571
I20260810 01:42:16.813155 24750 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:16.819717 24750 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:16.820456 24750 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:16.825650 24750 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d2103a3114e4115a2f2b4a021167568: Generated new TSK 0
I20260810 01:42:16.826189 24750 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 01:42:16.852041 24770 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 01:42:16.852113 24770 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 01:42:16.852607 24726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:16.837531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38442 (local address 127.16.58.126:39783)
0810 01:42:16.837656 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:16.837660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:16.837823 (+ 163us) server_negotiation.cc:407] Connection header received
0810 01:42:16.837965 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:16.837967 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:16.838010 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:16.838089 (+ 79us) server_negotiation.cc:226] Negotiated authn=JWT
0810 01:42:16.838321 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.838823 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.840070 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.840316 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.840393 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:16.840674 (+ 281us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 01:42:16.852332 (+ 11658us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36567/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 01:42:16.852503 (+ 171us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38442: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36567/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":48}
W20260810 01:42:16.852658 24726 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38442: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36567/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 01:42:16.852788 24769 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:16.837461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39783 (local address 127.0.0.1:38442)
0810 01:42:16.837741 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:16.837755 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:16.837865 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:16.838102 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:16.838105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:16.838113 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0810 01:42:16.838235 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:16.838242 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.838933 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.838936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:16.839953 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:16.839964 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:16.840417 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:16.840420 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:16.840514 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:16.840541 (+ 27us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 01:42:16.852474 (+ 11933us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36567/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 01:42:16.852620 (+ 146us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.58.126:39783: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36567/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":81,"threads_started":1}
I20260810 01:42:16.853294 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 24614
2026-08-10T01:42:16Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (288 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 01:42:16.903695 16617 mini_oidc.cc:152] Starting JWKS server
I20260810 01:42:16.904551 16617 webserver.cc:460] Webserver started at https://127.0.0.1:45809/ using document root <none> and password file <none>
I20260810 01:42:16.904644 16617 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 01:42:16.904896 16617 webserver.cc:460] Webserver started at http://127.0.0.1:46091/ using document root <none> and password file <none>
2026-08-10T01:42:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:16Z Disabled control of system clock
I20260810 01:42:16.913944 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:36785
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:38017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:36785
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45809/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 01:42:17.018659 24780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:17.018874 24780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:17.018909 24780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:17.022696 24780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:17.022738 24780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:17.022753 24780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:17.022769 24780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:17.022789 24780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 01:42:17.022804 24780 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 01:42:17.022815 24780 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45809/jwks.json
I20260810 01:42:17.027542 24780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:38017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:36785
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:36785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45809/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:17.028474 24780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:17.029667 24780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:17.037403 24780 server_base.cc:1034] running on GCE node
W20260810 01:42:17.037339 24785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:17.037380 24788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:17.037338 24786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:17.038120 24780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:17.039072 24780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:17.040236 24780 hybrid_clock.cc:648] HybridClock initialized: now 1786326137040219 us; error 28 us; skew 500 ppm
I20260810 01:42:17.041879 24780 webserver.cc:460] Webserver started at http://127.16.58.126:37837/ using document root <none> and password file <none>
I20260810 01:42:17.042392 24780 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:17.042456 24780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:17.042634 24780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:17.044548 24780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "0346deacddaf46a99efd92340585c90e"
format_stamp: "Formatted at 2026-08-10 01:42:17 on dist-test-slave-jlzn"
server_key: "c83a21014243b3a639c0c27c43a37995"
server_key_iv: "c65214ff3c910aede19f2200e7c77331"
server_key_version: "encryptionkey@0"
I20260810 01:42:17.045122 24780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "0346deacddaf46a99efd92340585c90e"
format_stamp: "Formatted at 2026-08-10 01:42:17 on dist-test-slave-jlzn"
server_key: "c83a21014243b3a639c0c27c43a37995"
server_key_iv: "c65214ff3c910aede19f2200e7c77331"
server_key_version: "encryptionkey@0"
I20260810 01:42:17.048477 24780 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:42:17.050606 24800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:17.051661 24780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:17.051769 24780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "0346deacddaf46a99efd92340585c90e"
format_stamp: "Formatted at 2026-08-10 01:42:17 on dist-test-slave-jlzn"
server_key: "c83a21014243b3a639c0c27c43a37995"
server_key_iv: "c65214ff3c910aede19f2200e7c77331"
server_key_version: "encryptionkey@0"
I20260810 01:42:17.051885 24780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:17.064000 24780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:17.064558 24780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:17.064710 24780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:17.070961 24780 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:36785
I20260810 01:42:17.070979 24884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:36785 every 8 connection(s)
I20260810 01:42:17.071780 24780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:17.074373 24885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:17.078714 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 24780
I20260810 01:42:17.078835 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:17.079068 16617 external_mini_cluster.cc:1428] Setting key e2100b2b6869998c13eae856698953bf
I20260810 01:42:17.079406 24885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e: Bootstrap starting.
I20260810 01:42:17.081696 24885 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:17.082358 24885 log.cc:824] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:17.084151 24885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e: No bootstrap required, opened a new log
I20260810 01:42:17.087527 24889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:17.080342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36180 (local address 127.16.58.126:36785)
0810 01:42:17.080970 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:17.080983 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:17.081015 (+ 32us) server_negotiation.cc:407] Connection header received
0810 01:42:17.081590 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:17.081614 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:17.081988 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:17.082276 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:17.082693 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.083647 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.084639 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.085089 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.085237 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:17.086000 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:17.086005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:17.086017 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:17.086360 (+ 343us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:17.086414 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:17.086433 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:17.086518 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:17.086657 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 01:42:17.086884 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":148,"threads_started":1}
I20260810 01:42:17.087450 24885 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0346deacddaf46a99efd92340585c90e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36785 } }
I20260810 01:42:17.087674 24885 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:17.087733 24885 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0346deacddaf46a99efd92340585c90e, State: Initialized, Role: FOLLOWER
I20260810 01:42:17.088129 24885 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0346deacddaf46a99efd92340585c90e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36785 } }
I20260810 01:42:17.088258 24885 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:17.088356 24885 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:17.088480 24885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:17.089274 24885 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0346deacddaf46a99efd92340585c90e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36785 } }
I20260810 01:42:17.089576 24885 leader_election.cc:302] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0346deacddaf46a99efd92340585c90e; no voters:
I20260810 01:42:17.089892 24885 leader_election.cc:288] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:17.089967 24892 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:17.090140 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:42:17.090198 24892 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [term 1 LEADER]: Becoming Leader. State: Replica: 0346deacddaf46a99efd92340585c90e, State: Running, Role: LEADER
I20260810 01:42:17.090467 24892 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0346deacddaf46a99efd92340585c90e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36785 } }
I20260810 01:42:17.091007 24885 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:17.091585 24892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0346deacddaf46a99efd92340585c90e. Latest consensus state: current_term: 1 leader_uuid: "0346deacddaf46a99efd92340585c90e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0346deacddaf46a99efd92340585c90e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36785 } } }
I20260810 01:42:17.091776 24892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:17.092213 24903 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:17.092329 24893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0346deacddaf46a99efd92340585c90e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0346deacddaf46a99efd92340585c90e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36785 } } }
I20260810 01:42:17.092465 24893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:17.095247 24903 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:17.100428 24903 catalog_manager.cc:1347] Generated new cluster ID: eedae25381504c869245232902da8624
I20260810 01:42:17.100494 24903 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:17.108453 24903 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:17.109504 24903 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:17.116022 24903 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0346deacddaf46a99efd92340585c90e: Generated new TSK 0
I20260810 01:42:17.116676 24903 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:42:17.130605 24889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:17.126200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36196 (local address 127.16.58.126:36785)
0810 01:42:17.126324 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:17.126329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:17.126491 (+ 162us) server_negotiation.cc:407] Connection header received
0810 01:42:17.126629 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:17.126636 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:17.126681 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:17.126759 (+ 78us) server_negotiation.cc:226] Negotiated authn=JWT
0810 01:42:17.126974 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.127467 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.128718 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.128922 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.128990 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:17.129289 (+ 299us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 01:42:17.130283 (+ 994us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45809/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 01:42:17.130479 (+ 196us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36196: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45809/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 01:42:17.130676 24889 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36196: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45809/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 01:42:17.130719 24926 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:17.126095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36785 (local address 127.0.0.1:36196)
0810 01:42:17.126410 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:17.126425 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:17.126532 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:17.126771 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:17.126774 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:17.126782 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0810 01:42:17.126889 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:17.126895 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.127574 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.127578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:17.128606 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:17.128619 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.129028 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.129031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:17.129130 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:17.129158 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 01:42:17.130425 (+ 1267us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45809/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 01:42:17.130556 (+ 131us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.58.126:36785: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45809/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":110,"threads_started":1}
I20260810 01:42:17.131006 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 24780
E20260810 01:42:17.146601 24927 webserver.cc:533] Webserver: sslize failed:
E20260810 01:42:17.146667 24927 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T01:42:17Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (273 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T01:42:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:17Z Disabled control of system clock
I20260810 01:42:17.186146 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:42699
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:39463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:42699
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/testchainca.cert with env {}
W20260810 01:42:17.292071 24933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:17.292310 24933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:17.292353 24933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:17.296685 24933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:17.296742 24933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:17.296757 24933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:17.296792 24933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:17.296820 24933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 01:42:17.296845 24933 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 01:42:17.296873 24933 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 01:42:17.302711 24933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:42699
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:42699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:17.303684 24933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:17.304662 24933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:17.312516 24940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:17.312567 24944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:17.312786 24933 server_base.cc:1034] running on GCE node
W20260810 01:42:17.312510 24947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:17.313426 24933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:17.314395 24933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:17.315552 24933 hybrid_clock.cc:648] HybridClock initialized: now 1786326137315530 us; error 32 us; skew 500 ppm
I20260810 01:42:17.317296 24933 webserver.cc:460] Webserver started at http://127.16.58.126:39307/ using document root <none> and password file <none>
I20260810 01:42:17.317811 24933 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:17.317883 24933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:17.318066 24933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:17.320010 24933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "3c0315b012ff4cfc8d5f115d14e65f8e"
format_stamp: "Formatted at 2026-08-10 01:42:17 on dist-test-slave-jlzn"
server_key: "0493cbae17e70a4021d03448bb1cb586"
server_key_iv: "b4cee28ed55f486b1e4baebea16f4846"
server_key_version: "encryptionkey@0"
I20260810 01:42:17.320549 24933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "3c0315b012ff4cfc8d5f115d14e65f8e"
format_stamp: "Formatted at 2026-08-10 01:42:17 on dist-test-slave-jlzn"
server_key: "0493cbae17e70a4021d03448bb1cb586"
server_key_iv: "b4cee28ed55f486b1e4baebea16f4846"
server_key_version: "encryptionkey@0"
I20260810 01:42:17.323846 24933 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:42:17.326171 24955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:17.327270 24933 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:17.327380 24933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "3c0315b012ff4cfc8d5f115d14e65f8e"
format_stamp: "Formatted at 2026-08-10 01:42:17 on dist-test-slave-jlzn"
server_key: "0493cbae17e70a4021d03448bb1cb586"
server_key_iv: "b4cee28ed55f486b1e4baebea16f4846"
server_key_version: "encryptionkey@0"
I20260810 01:42:17.327469 24933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:17.340724 24933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:17.341272 24933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:17.341421 24933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:17.347623 24933 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:42699
I20260810 01:42:17.347679 25023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:42699 every 8 connection(s)
I20260810 01:42:17.348493 24933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:17.351007 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 24933
I20260810 01:42:17.351126 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:17.351140 25026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:17.351413 16617 external_mini_cluster.cc:1428] Setting key 2eb9e1843dcd206a0bfa1e6291369fac
I20260810 01:42:17.357448 25026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e: Bootstrap starting.
I20260810 01:42:17.359754 25026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:17.360150 25031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:17.352614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45474 (local address 127.16.58.126:42699)
0810 01:42:17.353181 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:17.353196 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:17.353228 (+ 32us) server_negotiation.cc:407] Connection header received
0810 01:42:17.354049 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:17.354067 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:17.354424 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:17.354685 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:17.355022 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.355999 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.357142 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.357621 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.357733 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:17.358487 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:17.358492 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:17.358503 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:17.358838 (+ 335us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:17.358890 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:17.358908 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:17.358980 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:17.359117 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 01:42:17.359379 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":258,"thread_start_us":119,"threads_started":1}
I20260810 01:42:17.360526 25026 log.cc:824] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:17.362313 25026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e: No bootstrap required, opened a new log
I20260810 01:42:17.362670 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:42:17.365805 25026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0315b012ff4cfc8d5f115d14e65f8e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42699 } }
I20260810 01:42:17.365998 25026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:17.366043 25026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c0315b012ff4cfc8d5f115d14e65f8e, State: Initialized, Role: FOLLOWER
I20260810 01:42:17.366372 25026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0315b012ff4cfc8d5f115d14e65f8e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42699 } }
I20260810 01:42:17.366482 25026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:17.366528 25026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:17.366595 25026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:17.367367 25026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0315b012ff4cfc8d5f115d14e65f8e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42699 } }
I20260810 01:42:17.367666 25026 leader_election.cc:302] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c0315b012ff4cfc8d5f115d14e65f8e; no voters:
I20260810 01:42:17.367950 25026 leader_election.cc:288] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:17.368044 25033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:17.368259 25033 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [term 1 LEADER]: Becoming Leader. State: Replica: 3c0315b012ff4cfc8d5f115d14e65f8e, State: Running, Role: LEADER
I20260810 01:42:17.368594 25033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0315b012ff4cfc8d5f115d14e65f8e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42699 } }
I20260810 01:42:17.369071 25026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:17.370199 25036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c0315b012ff4cfc8d5f115d14e65f8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0315b012ff4cfc8d5f115d14e65f8e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42699 } } }
I20260810 01:42:17.370200 25037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c0315b012ff4cfc8d5f115d14e65f8e. Latest consensus state: current_term: 1 leader_uuid: "3c0315b012ff4cfc8d5f115d14e65f8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c0315b012ff4cfc8d5f115d14e65f8e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42699 } } }
I20260810 01:42:17.370380 25036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:17.370393 25037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:17.370831 25044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:17.373381 25044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:17.377988 25044 catalog_manager.cc:1347] Generated new cluster ID: 4dfbad9b69194b8d8963f9ab2ed1e3c4
I20260810 01:42:17.378051 25044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:17.395843 25044 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:17.396624 25044 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:17.408215 25044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c0315b012ff4cfc8d5f115d14e65f8e: Generated new TSK 0
I20260810 01:42:17.408857 25044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:42:17.435220 25031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:17.426272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45482 (local address 127.16.58.126:42699)
0810 01:42:17.426395 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:17.426400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:17.426538 (+ 138us) server_negotiation.cc:407] Connection header received
0810 01:42:17.426673 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:17.426676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:17.426734 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:17.426843 (+ 109us) server_negotiation.cc:226] Negotiated authn=JWT
0810 01:42:17.427015 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.427850 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.428667 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.429013 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.429113 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:17.429344 (+ 231us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 01:42:17.434864 (+ 5520us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 01:42:17.435093 (+ 229us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45482: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":46}
W20260810 01:42:17.435272 25072 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:17.426182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:42699 (local address 127.0.0.1:45482)
0810 01:42:17.426451 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:17.426465 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:17.426559 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:17.426832 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:17.426834 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:17.426839 (+ 5us) client_negotiation.cc:189] Negotiated authn=JWT
0810 01:42:17.426930 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:17.426934 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.427957 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.427959 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:17.428566 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:17.428573 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:17.429115 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:17.429118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:17.429182 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:17.429203 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 01:42:17.435017 (+ 5814us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 01:42:17.435142 (+ 125us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.16.58.126:42699: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":108,"threads_started":1}
W20260810 01:42:17.435285 25031 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45482: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260810 01:42:17.435948 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 24933
2026-08-10T01:42:17Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (287 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (121 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (119 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:17 dist-test-slave-jlzn krb5kdc[25091](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:17 dist-test-slave-jlzn krb5kdc[25091](info): set up 2 sockets
Aug 10 01:42:17 dist-test-slave-jlzn krb5kdc[25091](info): commencing operation
krb5kdc: starting...
W20260810 01:42:18.811954 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:18 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:42:18.928093 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:45483
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:38161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:45483
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:19.036523 25106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:19.036787 25106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:19.036825 25106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:19.040777 25106 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:19.040831 25106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:19.040856 25106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:19.040887 25106 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:19.040907 25106 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:19.046072 25106 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:38161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:45483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:45483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:19.047032 25106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:19.048059 25106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:19.056131 25106 server_base.cc:1034] running on GCE node
W20260810 01:42:19.056094 25116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:19.056109 25114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:19.056090 25112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:19.056962 25106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:19.057993 25106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:19.059152 25106 hybrid_clock.cc:648] HybridClock initialized: now 1786326139059135 us; error 34 us; skew 500 ppm
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.065416 25106 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:42:19.066259 25106 webserver.cc:460] Webserver started at http://127.16.58.126:41969/ using document root <none> and password file <none>
I20260810 01:42:19.066782 25106 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:19.066843 25106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:19.067044 25106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:19.069021 25106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "f6ebdd77fb26411b92f67d2625b7f97d"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "ffee1679989b5092805eb28dbb010d2a"
server_key_iv: "51c7b2829a59e28a0a72fa9cc73a1916"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.069541 25106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "f6ebdd77fb26411b92f67d2625b7f97d"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "ffee1679989b5092805eb28dbb010d2a"
server_key_iv: "51c7b2829a59e28a0a72fa9cc73a1916"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.073089 25106 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:19.075269 25126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.076439 25106 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:19.076551 25106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "f6ebdd77fb26411b92f67d2625b7f97d"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "ffee1679989b5092805eb28dbb010d2a"
server_key_iv: "51c7b2829a59e28a0a72fa9cc73a1916"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.076661 25106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:19.090082 25106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:19.092669 25106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:19.092829 25106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:19.099496 25106 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:45483
I20260810 01:42:19.099536 25203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:45483 every 8 connection(s)
I20260810 01:42:19.100428 25106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:19.102991 25205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:19.103644 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 25106
I20260810 01:42:19.103772 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:19.104113 16617 external_mini_cluster.cc:1428] Setting key d5c43c53b2b17ab8aa7498a7912b2700
I20260810 01:42:19.109105 25205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d: Bootstrap starting.
I20260810 01:42:19.111666 25205 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:19.112519 25205 log.cc:824] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:19.114647 25205 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d: No bootstrap required, opened a new log
I20260810 01:42:19.118180 25209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.105387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53528 (local address 127.16.58.126:45483)
0810 01:42:19.105776 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.105795 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.105828 (+ 33us) server_negotiation.cc:407] Connection header received
0810 01:42:19.106480 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.106496 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.106840 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.107099 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.107994 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.108942 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.110059 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.110515 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.110624 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.113356 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:19.113362 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:19.113377 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:19.113406 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:19.115175 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.115571 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.115578 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.115583 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.115728 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.115980 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.115983 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.115985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.116516 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:19.116724 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:19.116920 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 01:42:19.117233 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":107,"threads_started":1}
I20260810 01:42:19.118921 25205 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6ebdd77fb26411b92f67d2625b7f97d" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45483 } }
I20260810 01:42:19.119154 25205 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:19.119212 25205 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6ebdd77fb26411b92f67d2625b7f97d, State: Initialized, Role: FOLLOWER
I20260810 01:42:19.119675 25205 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6ebdd77fb26411b92f67d2625b7f97d" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45483 } }
I20260810 01:42:19.119851 25205 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:19.119918 25205 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:19.120011 25205 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:19.120910 25205 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6ebdd77fb26411b92f67d2625b7f97d" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45483 } }
I20260810 01:42:19.121198 25205 leader_election.cc:302] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6ebdd77fb26411b92f67d2625b7f97d; no voters:
I20260810 01:42:19.121464 25205 leader_election.cc:288] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:19.121570 25214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:19.121794 25214 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [term 1 LEADER]: Becoming Leader. State: Replica: f6ebdd77fb26411b92f67d2625b7f97d, State: Running, Role: LEADER
I20260810 01:42:19.122120 25214 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6ebdd77fb26411b92f67d2625b7f97d" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45483 } }
I20260810 01:42:19.122583 25205 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:19.123662 25215 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6ebdd77fb26411b92f67d2625b7f97d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6ebdd77fb26411b92f67d2625b7f97d" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45483 } } }
I20260810 01:42:19.123817 25215 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:19.124449 25216 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6ebdd77fb26411b92f67d2625b7f97d. Latest consensus state: current_term: 1 leader_uuid: "f6ebdd77fb26411b92f67d2625b7f97d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6ebdd77fb26411b92f67d2625b7f97d" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45483 } } }
I20260810 01:42:19.124606 25216 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d [sys.catalog]: This master's current role is: LEADER
W20260810 01:42:19.127166 25235 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:42:19.127243 25235 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:42:19.127307 25228 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:19.128072 25228 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:19.133737 25228 catalog_manager.cc:1347] Generated new cluster ID: e0e31a8c37ea4cc49077bdc04fff28fd
I20260810 01:42:19.133788 25228 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:19.157210 25228 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:19.158816 25228 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:19.165283 25228 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6ebdd77fb26411b92f67d2625b7f97d: Generated new TSK 0
I20260810 01:42:19.166056 25228 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:42:19.198797 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45483
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:38161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:19.314766 25244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:19.314985 25244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:19.315023 25244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:19.318881 25244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:19.318928 25244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:19.318980 25244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:19.323909 25244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:38161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:19.324910 25244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:19.325803 25244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:19.334601 25255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:19.334576 25251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:19.334569 25252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:19.334760 25244 server_base.cc:1034] running on GCE node
I20260810 01:42:19.335206 25244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:19.335775 25244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:19.336974 25244 hybrid_clock.cc:648] HybridClock initialized: now 1786326139336947 us; error 36 us; skew 500 ppm
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.339838 25244 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:42:19.340587 25244 webserver.cc:460] Webserver started at http://127.16.58.65:40557/ using document root <none> and password file <none>
I20260810 01:42:19.341061 25244 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:19.341115 25244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:19.341279 25244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:19.343093 25244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "1ce78baebc394dd2a61af17803421ec0"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "3a20b77aff3cdce739539b2a14f401d7"
server_key_iv: "f406e7d2dd9534e5c412589471815eb3"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.343566 25244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "1ce78baebc394dd2a61af17803421ec0"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "3a20b77aff3cdce739539b2a14f401d7"
server_key_iv: "f406e7d2dd9534e5c412589471815eb3"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.346874 25244 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:42:19.349041 25273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.350102 25244 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:19.350193 25244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "1ce78baebc394dd2a61af17803421ec0"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "3a20b77aff3cdce739539b2a14f401d7"
server_key_iv: "f406e7d2dd9534e5c412589471815eb3"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.350270 25244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:19.374332 25244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:19.376791 25244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:19.376933 25244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:19.377396 25244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:19.378129 25244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:19.378175 25244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.378211 25244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:19.378232 25244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.386155 25244 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:43919
I20260810 01:42:19.386217 25450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:43919 every 8 connection(s)
I20260810 01:42:19.387008 25244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:19.394935 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 25244
I20260810 01:42:19.395052 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:19.395326 16617 external_mini_cluster.cc:1428] Setting key 100a9d50d516f6cd1379b1003ede2bfd
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:19.399694 25209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.388674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:54089 (local address 127.16.58.126:45483)
0810 01:42:19.388785 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.388789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.389498 (+ 709us) server_negotiation.cc:407] Connection header received
0810 01:42:19.390790 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.390794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.390855 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.390933 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.392075 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.392602 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.393704 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.393943 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.394032 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.396446 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:19.396450 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:19.396453 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:19.396480 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:19.397753 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.398217 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.398221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.398223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.398304 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.398692 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.398696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.398697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.398910 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:19.399005 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:19.399410 (+ 405us) server_negotiation.cc:299] Negotiation successful
0810 01:42:19.399534 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 01:42:19.400369 25455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.388961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:45483 (local address 127.16.58.65:54089)
0810 01:42:19.389360 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:19.389399 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:19.390587 (+ 1188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:19.391116 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:19.391132 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:19.391450 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:19.391926 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:19.391939 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.392728 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.392731 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:19.393588 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:19.393597 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.394080 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.394084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:19.394247 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.394744 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:19.394760 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:19.396287 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:19.397862 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:19.397867 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:19.397881 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:19.398123 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:19.398415 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:19.398418 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:19.398421 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:19.398599 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:19.398994 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:19.398998 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:19.399205 (+ 207us) client_negotiation.cc:769] Sending connection context
0810 01:42:19.399348 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 01:42:19.399571 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":104,"threads_started":1}
I20260810 01:42:19.401446 25452 heartbeater.cc:347] Connected to a master server at 127.16.58.126:45483
I20260810 01:42:19.401659 25452 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:19.402082 25452 heartbeater.cc:511] Master 127.16.58.126:45483 requested a full tablet report, sending...
I20260810 01:42:19.403425 25146 ts_manager.cc:194] Registered new tserver with Master: 1ce78baebc394dd2a61af17803421ec0 (127.16.58.65:43919)
I20260810 01:42:19.404515 25146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:54089
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:42:19.421953 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45483
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:38161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:19.528343 25459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:19.528549 25459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:19.528590 25459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:19.532846 25459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:19.532895 25459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:19.532960 25459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:19.537834 25459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:38161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:19.538697 25459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:19.539578 25459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:19.548307 25467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:19.548357 25470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:19.548436 25459 server_base.cc:1034] running on GCE node
W20260810 01:42:19.548341 25466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:19.548861 25459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:19.549448 25459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:19.550613 25459 hybrid_clock.cc:648] HybridClock initialized: now 1786326139550582 us; error 42 us; skew 500 ppm
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.553184 25459 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:42:19.553988 25459 webserver.cc:460] Webserver started at http://127.16.58.66:34375/ using document root <none> and password file <none>
I20260810 01:42:19.554456 25459 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:19.554510 25459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:19.554672 25459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:19.556551 25459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "80db66b388cb436a90ea360b38c95a4d"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "54d8d6cb4b28668e0f0c3fff8ba00eac"
server_key_iv: "d292f0531d39ac2551884e2455127028"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.557060 25459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "80db66b388cb436a90ea360b38c95a4d"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "54d8d6cb4b28668e0f0c3fff8ba00eac"
server_key_iv: "d292f0531d39ac2551884e2455127028"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.560452 25459 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:19.562595 25481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.563679 25459 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:19.563787 25459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "80db66b388cb436a90ea360b38c95a4d"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "54d8d6cb4b28668e0f0c3fff8ba00eac"
server_key_iv: "d292f0531d39ac2551884e2455127028"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.563905 25459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:19.579485 25459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:19.582361 25459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:19.582521 25459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:19.583026 25459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:19.583771 25459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:19.583842 25459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.583899 25459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:19.583925 25459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.592046 25459 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:36955
I20260810 01:42:19.592072 25647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:36955 every 8 connection(s)
I20260810 01:42:19.592809 25459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:19.597093 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 25459
I20260810 01:42:19.597227 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:19.597517 16617 external_mini_cluster.cc:1428] Setting key 7ef2fce161024ca4252615d5a18a2486
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:19.605489 25209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.594338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:40367 (local address 127.16.58.126:45483)
0810 01:42:19.594459 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.594462 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.595224 (+ 762us) server_negotiation.cc:407] Connection header received
0810 01:42:19.596547 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.596550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.596595 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.596673 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.598029 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.598578 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.599662 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.599918 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.600004 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.602402 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:19.602406 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:19.602407 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:19.602431 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:19.603591 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.604099 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.604103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.604105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.604192 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.604496 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.604500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.604501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.604673 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:19.604758 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:19.605213 (+ 455us) server_negotiation.cc:299] Negotiation successful
0810 01:42:19.605334 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:42:19.606169 25654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.594622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:45483 (local address 127.16.58.66:40367)
0810 01:42:19.595082 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:19.595132 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:19.596372 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:19.596805 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:19.596811 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:19.597254 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:19.597865 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:19.597886 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.598706 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.598709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:19.599540 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:19.599549 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.600061 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.600065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:19.600215 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.600695 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:19.600716 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:19.602257 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:19.603697 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:19.603703 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:19.603715 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:19.604009 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:19.604276 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:19.604279 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:19.604281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:19.604412 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:19.604774 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:19.604780 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:19.604992 (+ 212us) client_negotiation.cc:769] Sending connection context
0810 01:42:19.605143 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 01:42:19.605420 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":112,"threads_started":1}
I20260810 01:42:19.607167 25651 heartbeater.cc:347] Connected to a master server at 127.16.58.126:45483
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:42:19.607399 25651 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:19.607916 25651 heartbeater.cc:511] Master 127.16.58.126:45483 requested a full tablet report, sending...
I20260810 01:42:19.608865 25146 ts_manager.cc:194] Registered new tserver with Master: 80db66b388cb436a90ea360b38c95a4d (127.16.58.66:36955)
I20260810 01:42:19.609436 25146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:40367
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:42:19.623726 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45483
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:38161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:19.729542 25662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:19.729765 25662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:19.729803 25662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:19.733687 25662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:19.733733 25662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:19.733788 25662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:19.738708 25662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:38161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:45483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:19.739547 25662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:19.740484 25662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:19.749631 25668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:19.749748 25662 server_base.cc:1034] running on GCE node
W20260810 01:42:19.749637 25669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:19.749643 25673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:19.750238 25662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:19.750782 25662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:19.751926 25662 hybrid_clock.cc:648] HybridClock initialized: now 1786326139751903 us; error 35 us; skew 500 ppm
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.757099 25662 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:42:19.757862 25662 webserver.cc:460] Webserver started at http://127.16.58.67:41251/ using document root <none> and password file <none>
I20260810 01:42:19.758356 25662 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:19.758421 25662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:19.758608 25662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:19.760524 25662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "7c45c8eef07b455092ba5cd82433ae4a"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "14753ee8eef9f71c124a4f0558b86a01"
server_key_iv: "70755fea6ddac4aab7bb53018842c18b"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.761032 25662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "7c45c8eef07b455092ba5cd82433ae4a"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "14753ee8eef9f71c124a4f0558b86a01"
server_key_iv: "70755fea6ddac4aab7bb53018842c18b"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.764407 25662 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:42:19.766563 25681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.767674 25662 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:19.767774 25662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "7c45c8eef07b455092ba5cd82433ae4a"
format_stamp: "Formatted at 2026-08-10 01:42:19 on dist-test-slave-jlzn"
server_key: "14753ee8eef9f71c124a4f0558b86a01"
server_key_iv: "70755fea6ddac4aab7bb53018842c18b"
server_key_version: "encryptionkey@0"
I20260810 01:42:19.767877 25662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:19.778961 25662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:19.781554 25662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:19.781715 25662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:19.782232 25662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:19.782974 25662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:19.783020 25662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.783068 25662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:19.783097 25662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:19.791052 25662 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:34853
I20260810 01:42:19.791102 25842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:34853 every 8 connection(s)
I20260810 01:42:19.791901 25662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:19.799559 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 25662
I20260810 01:42:19.799670 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:19.799973 16617 external_mini_cluster.cc:1428] Setting key 3e5f14c2c4d3dd363860652f7292402b
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:19.804497 25209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.793506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:53009 (local address 127.16.58.126:45483)
0810 01:42:19.793631 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.793634 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.794352 (+ 718us) server_negotiation.cc:407] Connection header received
0810 01:42:19.795636 (+ 1284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.795639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.795700 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.795771 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.796877 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.797406 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.798499 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.798733 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.798822 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.801505 (+ 2683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:19.801508 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:19.801510 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:19.801536 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:19.802848 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.803288 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.803290 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.803292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.803367 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.803611 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.803613 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.803614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.803778 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:19.803889 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:19.804285 (+ 396us) server_negotiation.cc:299] Negotiation successful
0810 01:42:19.804379 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:42:19.805181 25845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.793804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:45483 (local address 127.16.58.67:53009)
0810 01:42:19.794216 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:19.794255 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:19.795423 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:19.795964 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:19.795971 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:19.796298 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:19.796737 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:19.796751 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.797521 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.797524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:19.798383 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:19.798392 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.798896 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.798901 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:19.799049 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.799573 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:19.799589 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:19.801371 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:19.802947 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:19.802952 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:19.802962 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:19.803211 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:19.803430 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:19.803432 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:19.803433 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:19.803548 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:19.803888 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:19.803893 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:19.804095 (+ 202us) client_negotiation.cc:769] Sending connection context
0810 01:42:19.804248 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 01:42:19.804464 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":102,"threads_started":1}
I20260810 01:42:19.806190 25843 heartbeater.cc:347] Connected to a master server at 127.16.58.126:45483
I20260810 01:42:19.806384 25843 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:19.806799 25843 heartbeater.cc:511] Master 127.16.58.126:45483 requested a full tablet report, sending...
I20260810 01:42:19.807749 25146 ts_manager.cc:194] Registered new tserver with Master: 7c45c8eef07b455092ba5cd82433ae4a (127.16.58.67:34853)
I20260810 01:42:19.808305 25146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:53009
I20260810 01:42:19.813568 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/test-admin.keytab.
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.829002 16617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 01:42:19.831451 25851 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:19.830205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44908 (local address 127.16.58.65:43919)
0810 01:42:19.830538 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.830547 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.830570 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:42:19.830617 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.830630 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.830793 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.830901 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.831281 (+ 380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44908: BlockingRecv error: recv got EOF from 127.0.0.1:44908 (error 108)
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":133,"threads_started":1}
W20260810 01:42:19.831545 16617 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5cc' of type FILE
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.832442 16617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.833222 16617 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:42:19.841459 25851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.833988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44924 (local address 127.16.58.65:43919)
0810 01:42:19.834113 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.834116 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.834166 (+ 50us) server_negotiation.cc:407] Connection header received
0810 01:42:19.834252 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.834254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.834288 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.834348 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.834774 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.835508 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.836338 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.836704 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.836783 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.838744 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:19.838753 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:19.838765 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:19.838786 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:19.840081 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.840436 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.840441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.840442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.840513 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.840693 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.840695 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.840696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.840907 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:19.841055 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:19.841180 (+ 125us) server_negotiation.cc:299] Negotiation successful
0810 01:42:19.841318 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 01:42:19.844787 25851 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:19.843933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44932 (local address 127.16.58.65:43919)
0810 01:42:19.844044 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.844047 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.844116 (+ 69us) server_negotiation.cc:407] Connection header received
0810 01:42:19.844233 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.844236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.844272 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.844332 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.844698 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44932: BlockingRecv error: recv got EOF from 127.0.0.1:44932 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 01:42:19.844892 16617 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5cc' of type FILE
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.845726 16617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.846485 16617 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:42:19.853643 25851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.847170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44942 (local address 127.16.58.65:43919)
0810 01:42:19.847276 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.847280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.847364 (+ 84us) server_negotiation.cc:407] Connection header received
0810 01:42:19.847459 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.847461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.847491 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.847542 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.847971 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.848446 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.849140 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.849348 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.849421 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.851206 (+ 1785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:19.851209 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:19.851211 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:19.851230 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:19.852431 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.852742 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.852744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.852745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.852808 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.853002 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.853004 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.853005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.853136 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:19.853222 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:19.853405 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 01:42:19.853510 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 01:42:19.855840 25851 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:19.855132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44958 (local address 127.16.58.65:43919)
0810 01:42:19.855250 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.855253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.855300 (+ 47us) server_negotiation.cc:407] Connection header received
0810 01:42:19.855377 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.855378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.855408 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.855463 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.855731 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44958: BlockingRecv error: recv got EOF from 127.0.0.1:44958 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260810 01:42:19.855943 16617 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786326110151381-16617-0/krb5kdc/krb5cc' of type FILE
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.856776 16617 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:19.857520 16617 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25091](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:42:19.864382 25851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:19.858182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44960 (local address 127.16.58.65:43919)
0810 01:42:19.858289 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:19.858291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:19.858328 (+ 37us) server_negotiation.cc:407] Connection header received
0810 01:42:19.858406 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:19.858408 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:19.858437 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:19.858493 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:19.858866 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.859306 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.860026 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:19.860223 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:19.860290 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:19.862022 (+ 1732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:19.862025 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:19.862027 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:19.862047 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:19.863056 (+ 1009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.863440 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.863443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.863444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.863516 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:19.863697 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:19.863698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:19.863699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:19.863854 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:19.863968 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:19.864161 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 01:42:19.864252 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:19.865128 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 25244
I20260810 01:42:19.878270 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 25459
I20260810 01:42:19.890864 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 25662
I20260810 01:42:19.902001 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 25106
2026-08-10T01:42:19Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2218 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25866](info): set up 2 sockets
Aug 10 01:42:19 dist-test-slave-jlzn krb5kdc[25866](info): commencing operation
krb5kdc: starting...
W20260810 01:42:21.036062 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:21 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:21Z Disabled control of system clock
WARNING: no policy specified for oryx/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.126.keytab.
Entry for principal oryx/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.126.keytab.
I20260810 01:42:21.151950 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:46803
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.126.keytab
--principal=oryx/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:46803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:21.259266 25891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:21.259513 25891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:21.259567 25891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:21.263455 25891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:21.263510 25891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:21.263536 25891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:21.263556 25891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:21.263577 25891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:21.268661 25891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:46803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.126.keytab
--principal=oryx/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:46803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:21.269621 25891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:21.270576 25891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:21.278474 25899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:21.278595 25891 server_base.cc:1034] running on GCE node
W20260810 01:42:21.278478 25900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:21.278512 25902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:21.279255 25891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:21.280308 25891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:21.281466 25891 hybrid_clock.cc:648] HybridClock initialized: now 1786326141281439 us; error 38 us; skew 500 ppm
Aug 10 01:42:21 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:21.284085 25891 init.cc:377] Logged in from keytab as oryx/127.16.58.126@KRBTEST.COM (short username oryx)
I20260810 01:42:21.284859 25891 webserver.cc:460] Webserver started at http://127.16.58.126:37699/ using document root <none> and password file <none>
I20260810 01:42:21.285344 25891 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:21.285399 25891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:21.285558 25891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:21.287459 25891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "d866d3607576fd448a15f537c2a86436"
server_key_iv: "16d6694b8f24912109a7cd0ccc40e094"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.288002 25891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "d866d3607576fd448a15f537c2a86436"
server_key_iv: "16d6694b8f24912109a7cd0ccc40e094"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.291630 25891 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:42:21.293893 25912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:21.295017 25891 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:21.295121 25891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "d866d3607576fd448a15f537c2a86436"
server_key_iv: "16d6694b8f24912109a7cd0ccc40e094"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.295221 25891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:21.316360 25891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:21.319191 25891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:21.319356 25891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:21.326083 25891 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:46803
I20260810 01:42:21.326354 25977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:46803 every 8 connection(s)
I20260810 01:42:21.326972 25891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:21.329578 25979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:21.334789 25979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: Bootstrap starting.
I20260810 01:42:21.337003 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 25891
I20260810 01:42:21.337150 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:21.337177 25979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:21.337479 16617 external_mini_cluster.cc:1428] Setting key f24cf94a5f5cd76ea03fdf1de8824e1c
I20260810 01:42:21.338002 25979 log.cc:824] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:21.340296 25979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: No bootstrap required, opened a new log
I20260810 01:42:21.344635 25979 raft_consensus.cc:348] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } }
I20260810 01:42:21.344892 25979 raft_consensus.cc:374] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:21.344955 25979 raft_consensus.cc:729] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b897ecaaba574aa4a0fc0e12a3e6e77c, State: Initialized, Role: FOLLOWER
I20260810 01:42:21.345417 25979 consensus_queue.cc:260] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } }
I20260810 01:42:21.345549 25979 raft_consensus.cc:388] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:21.345620 25979 raft_consensus.cc:482] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:21.345732 25979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:21.346760 25979 raft_consensus.cc:504] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } }
Aug 10 01:42:21 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:21.347098 25979 leader_election.cc:302] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b897ecaaba574aa4a0fc0e12a3e6e77c; no voters:
I20260810 01:42:21.347427 25979 leader_election.cc:288] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:21.347515 25987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:21.347728 25987 raft_consensus.cc:686] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 1 LEADER]: Becoming Leader. State: Replica: b897ecaaba574aa4a0fc0e12a3e6e77c, State: Running, Role: LEADER
I20260810 01:42:21.348096 25987 consensus_queue.cc:237] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } }
I20260810 01:42:21.348809 25979 sys_catalog.cc:564] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:21.349640 25989 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b897ecaaba574aa4a0fc0e12a3e6e77c. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } }
I20260810 01:42:21.349764 25989 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:21.350064 25988 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } }
I20260810 01:42:21.350167 25988 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:21.352774 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:21.338570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40572 (local address 127.16.58.126:46803)
0810 01:42:21.338998 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:21.339017 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:21.339058 (+ 41us) server_negotiation.cc:407] Connection header received
0810 01:42:21.339902 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:21.339924 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:21.340303 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:21.340645 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:21.341281 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.342741 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.343609 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.344370 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.344586 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:21.347388 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:21.347395 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:21.347411 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:21.347445 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:21.349472 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:21.350037 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:21.350043 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:21.350050 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:21.350402 (+ 352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:21.350740 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:21.350744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:21.350746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:21.351269 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:21.351463 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:21.351731 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 01:42:21.352005 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":119,"threads_started":1}
W20260810 01:42:21.353766 26011 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:42:21.353832 26011 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:42:21.353907 25999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:21.354553 25999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:21.359587 25999 catalog_manager.cc:1347] Generated new cluster ID: e41304b9e4724e6bb5d03718aa96a1ba
I20260810 01:42:21.359645 25999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:21.391860 25999 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:21.393112 25999 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:21.399338 25999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: Generated new TSK 0
I20260810 01:42:21.400120 25999 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab.
Entry for principal oryx/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab.
I20260810 01:42:21.432899 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:46803
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab
--principal=oryx/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:21.542549 26019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:21.542797 26019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:21.542837 26019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:21.546658 26019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:21.546703 26019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:21.546756 26019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:21.551757 26019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab
--principal=oryx/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:46803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:21.552664 26019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:21.553570 26019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:21.562717 26019 server_base.cc:1034] running on GCE node
W20260810 01:42:21.562733 26028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:21.562736 26029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:21.562703 26031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:21.563267 26019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:21.563843 26019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:21.564997 26019 hybrid_clock.cc:648] HybridClock initialized: now 1786326141564976 us; error 32 us; skew 500 ppm
Aug 10 01:42:21 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:21.567495 26019 init.cc:377] Logged in from keytab as oryx/127.16.58.65@KRBTEST.COM (short username oryx)
I20260810 01:42:21.568348 26019 webserver.cc:460] Webserver started at http://127.16.58.65:36901/ using document root <none> and password file <none>
I20260810 01:42:21.568864 26019 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:21.568930 26019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:21.569118 26019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:21.571007 26019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "b666df6160dc4525abeec7d3d3baf26d"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "235acf67bb3804dff2c6fc505fea4f7e"
server_key_iv: "84b82bc027f97ee2152e59fb305da344"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.571560 26019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "b666df6160dc4525abeec7d3d3baf26d"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "235acf67bb3804dff2c6fc505fea4f7e"
server_key_iv: "84b82bc027f97ee2152e59fb305da344"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.575055 26019 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:42:21.577351 26040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:21.578495 26019 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260810 01:42:21.578600 26019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "b666df6160dc4525abeec7d3d3baf26d"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "235acf67bb3804dff2c6fc505fea4f7e"
server_key_iv: "84b82bc027f97ee2152e59fb305da344"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.578692 26019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:21.597519 26019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:21.600214 26019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:21.600368 26019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:21.600879 26019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:21.601617 26019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:21.601667 26019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:21.601716 26019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:21.601742 26019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:21.609810 26019 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:38325
I20260810 01:42:21.609840 26198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:38325 every 8 connection(s)
I20260810 01:42:21.610584 26019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:21.618448 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 26019
I20260810 01:42:21.618546 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:21.618804 16617 external_mini_cluster.cc:1428] Setting key 0970e54d91122ef5d8ecd67a75c06554
Aug 10 01:42:21 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:21.623098 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:21.612230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:46771 (local address 127.16.58.126:46803)
0810 01:42:21.612362 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:21.612367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:21.613181 (+ 814us) server_negotiation.cc:407] Connection header received
0810 01:42:21.614425 (+ 1244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:21.614429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:21.614476 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:21.614542 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:21.615558 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.616138 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.617247 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.617458 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.617526 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:21.619763 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:21.619768 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:21.619770 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:21.619796 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:21.621194 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:21.621640 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:21.621644 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:21.621646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:21.621744 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:21.622022 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:21.622025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:21.622027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:21.622252 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:21.622330 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:21.622885 (+ 555us) server_negotiation.cc:299] Negotiation successful
0810 01:42:21.622983 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:42:21.624063 26202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:21.612604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.65:46771)
0810 01:42:21.613039 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:21.613079 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:21.614247 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:21.614685 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:21.614691 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:21.615018 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:21.615443 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:21.615457 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.616269 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.616272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:21.617150 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:21.617160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.617560 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.617562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:21.617698 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:21.618198 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:21.618214 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:21.619608 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:21.621301 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:21.621306 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:21.621315 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:21.621551 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:21.621825 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:21.621827 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:21.621829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:21.621948 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:21.622347 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:21.622353 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:21.622647 (+ 294us) client_negotiation.cc:769] Sending connection context
0810 01:42:21.622836 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 01:42:21.623132 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":122,"threads_started":1}
I20260810 01:42:21.625227 26199 heartbeater.cc:347] Connected to a master server at 127.16.58.126:46803
I20260810 01:42:21.625460 26199 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:21.625993 26199 heartbeater.cc:511] Master 127.16.58.126:46803 requested a full tablet report, sending...
I20260810 01:42:21.627416 25932 ts_manager.cc:194] Registered new tserver with Master: b666df6160dc4525abeec7d3d3baf26d (127.16.58.65:38325)
I20260810 01:42:21.628509 25932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:46771
WARNING: no policy specified for oryx/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab.
Entry for principal oryx/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab.
I20260810 01:42:21.644598 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:46803
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab
--principal=oryx/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:21.750299 26207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:21.750514 26207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:21.750555 26207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:21.754424 26207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:21.754472 26207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:21.754536 26207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:21.759482 26207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab
--principal=oryx/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:46803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:21.760345 26207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:21.761202 26207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:21.769855 26213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:21.769872 26212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:21.769922 26207 server_base.cc:1034] running on GCE node
W20260810 01:42:21.769865 26215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:21.770416 26207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:21.770958 26207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:21.772106 26207 hybrid_clock.cc:648] HybridClock initialized: now 1786326141772088 us; error 29 us; skew 500 ppm
Aug 10 01:42:21 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:21.774628 26207 init.cc:377] Logged in from keytab as oryx/127.16.58.66@KRBTEST.COM (short username oryx)
I20260810 01:42:21.775395 26207 webserver.cc:460] Webserver started at http://127.16.58.66:37171/ using document root <none> and password file <none>
I20260810 01:42:21.775898 26207 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:21.775962 26207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:21.776129 26207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:21.777911 26207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "c4ea2580b73a4a12a637936b987c4369"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "983dc48539d89b48311b5798270aa597"
server_key_iv: "91c9e14431b28e410e8d0f2bd69cef6f"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.778411 26207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "c4ea2580b73a4a12a637936b987c4369"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "983dc48539d89b48311b5798270aa597"
server_key_iv: "91c9e14431b28e410e8d0f2bd69cef6f"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.781881 26207 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:42:21.784052 26223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:21.785264 26207 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:21.785367 26207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "c4ea2580b73a4a12a637936b987c4369"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "983dc48539d89b48311b5798270aa597"
server_key_iv: "91c9e14431b28e410e8d0f2bd69cef6f"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.785446 26207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:21.798127 26207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:21.800987 26207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:21.801129 26207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:21.801605 26207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:21.802330 26207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:21.802384 26207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:21.802426 26207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:21.802446 26207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:21.810487 26207 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:35995
I20260810 01:42:21.810513 26389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:35995 every 8 connection(s)
I20260810 01:42:21.811308 26207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:21.820043 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 26207
Aug 10 01:42:21 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:21.820168 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:21.820417 16617 external_mini_cluster.cc:1428] Setting key b217eeaf13f2b1621b317db20d208fbd
I20260810 01:42:21.824193 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:21.812974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:60719 (local address 127.16.58.126:46803)
0810 01:42:21.813103 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:21.813107 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:21.813860 (+ 753us) server_negotiation.cc:407] Connection header received
0810 01:42:21.815165 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:21.815169 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:21.815229 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:21.815302 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:21.816468 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.817012 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.818121 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.818347 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.818438 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:21.820732 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:21.820737 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:21.820739 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:21.820768 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:21.822155 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:21.822681 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:21.822683 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:21.822684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:21.822753 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:21.823089 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:21.823091 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:21.823092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:21.823254 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:21.823323 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:21.823921 (+ 598us) server_negotiation.cc:299] Negotiation successful
0810 01:42:21.824039 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:42:21.825001 26396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:21.813300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.66:60719)
0810 01:42:21.813720 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:21.813761 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:21.814958 (+ 1197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:21.815475 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:21.815482 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:21.815852 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:21.816323 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:21.816337 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.817138 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.817141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:21.817999 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:21.818009 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:21.818484 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:21.818488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:21.818645 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:21.819123 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:21.819139 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:21.820573 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:21.822265 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:21.822271 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:21.822284 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:21.822597 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:21.822829 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:21.822831 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:21.822833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:21.822999 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:21.823339 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:21.823345 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:21.823634 (+ 289us) client_negotiation.cc:769] Sending connection context
0810 01:42:21.823870 (+ 236us) client_negotiation.cc:240] Negotiation successful
0810 01:42:21.824114 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":112,"threads_started":1}
I20260810 01:42:21.826013 26391 heartbeater.cc:347] Connected to a master server at 127.16.58.126:46803
I20260810 01:42:21.826228 26391 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:21.826707 26391 heartbeater.cc:511] Master 127.16.58.126:46803 requested a full tablet report, sending...
I20260810 01:42:21.827672 25932 ts_manager.cc:194] Registered new tserver with Master: c4ea2580b73a4a12a637936b987c4369 (127.16.58.66:35995)
I20260810 01:42:21.828241 25932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:60719
WARNING: no policy specified for oryx/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab.
Entry for principal oryx/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab.
I20260810 01:42:21.846868 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:46803
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab
--principal=oryx/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:21.953584 26401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:21.953805 26401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:21.953845 26401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:21.957646 26401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:21.957688 26401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:21.957741 26401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:21.962589 26401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab
--principal=oryx/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:46803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:21.963387 26401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:21.964246 26401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:21.973107 26412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:21.973090 26409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:21.973079 26408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:21.973176 26401 server_base.cc:1034] running on GCE node
I20260810 01:42:21.973649 26401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:21.974197 26401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:21.975343 26401 hybrid_clock.cc:648] HybridClock initialized: now 1786326141975326 us; error 28 us; skew 500 ppm
Aug 10 01:42:21 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:21.977881 26401 init.cc:377] Logged in from keytab as oryx/127.16.58.67@KRBTEST.COM (short username oryx)
I20260810 01:42:21.978593 26401 webserver.cc:460] Webserver started at http://127.16.58.67:36871/ using document root <none> and password file <none>
I20260810 01:42:21.979059 26401 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:21.979115 26401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:21.979274 26401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:21.981086 26401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "d2a5c24b0baf4b4987ba081c001ca95d"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "dff59f6b71e0a5d4daafd1ed21794c74"
server_key_iv: "ee4851acfe0572034f9e7b38ea22bf5d"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.981557 26401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "d2a5c24b0baf4b4987ba081c001ca95d"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "dff59f6b71e0a5d4daafd1ed21794c74"
server_key_iv: "ee4851acfe0572034f9e7b38ea22bf5d"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.984965 26401 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:21.987006 26423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:21.988119 26401 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:21.988238 26401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "d2a5c24b0baf4b4987ba081c001ca95d"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "dff59f6b71e0a5d4daafd1ed21794c74"
server_key_iv: "ee4851acfe0572034f9e7b38ea22bf5d"
server_key_version: "encryptionkey@0"
I20260810 01:42:21.988320 26401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:22.007277 26401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:22.009858 26401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:22.009992 26401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:22.010450 26401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:22.011165 26401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:22.011210 26401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.011246 26401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:22.011266 26401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.019040 26401 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:40727
I20260810 01:42:22.019068 26574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:40727 every 8 connection(s)
I20260810 01:42:22.019830 26401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:22.022861 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 26401
I20260810 01:42:22.022948 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:22.023180 16617 external_mini_cluster.cc:1428] Setting key f5dfb5415bca8ffef085fbc70b53665e
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:22.032106 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.021403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:43695 (local address 127.16.58.126:46803)
0810 01:42:22.021536 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.021540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.022270 (+ 730us) server_negotiation.cc:407] Connection header received
0810 01:42:22.023580 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.023583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.023643 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.023716 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.024938 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.025473 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.026556 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.026773 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.026860 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.029085 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.029087 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.029090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.029113 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.030244 (+ 1131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.030695 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.030698 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.030699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.030777 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.031076 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.031080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.031082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.031258 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.031344 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.031827 (+ 483us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.031950 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:42:22.032773 26580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.021723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.67:43695)
0810 01:42:22.022131 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.022172 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.023382 (+ 1210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.023930 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.023939 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.024286 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.024800 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.024813 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.025589 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.025592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.026436 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.026445 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.026903 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.026908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.027063 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.027551 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.027566 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.028932 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.030347 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.030352 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.030365 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.030596 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.030857 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.030860 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.030862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.030989 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.031354 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.031361 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.031584 (+ 223us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.031745 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.032046 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":116,"threads_started":1}
I20260810 01:42:22.033707 26575 heartbeater.cc:347] Connected to a master server at 127.16.58.126:46803
I20260810 01:42:22.033905 26575 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:22.034319 26575 heartbeater.cc:511] Master 127.16.58.126:46803 requested a full tablet report, sending...
I20260810 01:42:22.035207 25932 ts_manager.cc:194] Registered new tserver with Master: d2a5c24b0baf4b4987ba081c001ca95d (127.16.58.67:40727)
I20260810 01:42:22.035898 25932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:43695
I20260810 01:42:22.036741 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.16.58.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.125.keytab.
Entry for principal oryx/127.16.58.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.125.keytab.
I20260810 01:42:22.061821 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.125:33201
--webserver_interface=127.16.58.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.125.keytab
--principal=oryx/127.16.58.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:46803,127.16.58.125:33201
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:22.167866 26583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:22.168111 26583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:22.168174 26583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:22.172111 26583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:22.172169 26583 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:22.172195 26583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:22.172217 26583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:22.172247 26583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:22.177242 26583 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:46803,127.16.58.125:33201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.125.keytab
--principal=oryx/127.16.58.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.125:33201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.58.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26583
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
W20260810 01:42:22.177428 26583 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.16.58.126:46803,127.16.58.125:33201'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 01:42:22.178190 26583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:22.179092 26583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:22.187047 26588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:22.187028 26592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:22.187115 26583 server_base.cc:1034] running on GCE node
W20260810 01:42:22.187027 26594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:22.187757 26583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:22.188788 26583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:22.189939 26583 hybrid_clock.cc:648] HybridClock initialized: now 1786326142189915 us; error 38 us; skew 500 ppm
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:22.192553 26583 init.cc:377] Logged in from keytab as oryx/127.16.58.125@KRBTEST.COM (short username oryx)
I20260810 01:42:22.193382 26583 webserver.cc:460] Webserver started at http://127.16.58.125:46357/ using document root <none> and password file <none>
I20260810 01:42:22.193876 26583 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:22.193938 26583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:22.194126 26583 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:22.196074 26583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data/instance:
uuid: "0efcb078845c46d09725431e5357e9c5"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "fa1d934c3c59503ebdeb2ce25da7e7a8"
server_key_iv: "294946b2b8410eab4faaa7dc99bc9471"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.196602 26583 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal/instance:
uuid: "0efcb078845c46d09725431e5357e9c5"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "fa1d934c3c59503ebdeb2ce25da7e7a8"
server_key_iv: "294946b2b8410eab4faaa7dc99bc9471"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.200028 26583 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:22.202140 26604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.203199 26583 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:22.203318 26583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal
uuid: "0efcb078845c46d09725431e5357e9c5"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "fa1d934c3c59503ebdeb2ce25da7e7a8"
server_key_iv: "294946b2b8410eab4faaa7dc99bc9471"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.203404 26583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:22.230904 26583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:22.233497 26583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:22.233675 26583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:22.240245 26583 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.125:33201
I20260810 01:42:22.240494 26677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.125:33201 every 8 connection(s)
I20260810 01:42:22.241153 26583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
I20260810 01:42:22.243711 26679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:22.247032 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 26583
I20260810 01:42:22.247409 26679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.125@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.58.125@KRBTEST.COM
I20260810 01:42:22.258955 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.249208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55128 (local address 127.16.58.126:46803)
0810 01:42:22.249334 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.249338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.249568 (+ 230us) server_negotiation.cc:407] Connection header received
0810 01:42:22.249975 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.249978 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.250033 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.250105 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.251040 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.251563 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.252656 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.252900 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.252977 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.255424 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.255427 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.255429 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.255453 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.256899 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.257422 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.257424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.257425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.257491 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.257797 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.257800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.257801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.258053 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.258168 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.258646 (+ 478us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.258765 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:42:22.259959 26683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.249114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55128)
0810 01:42:22.249441 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.249488 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.249796 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.250207 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.250212 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.250614 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.250898 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.250911 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.251677 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.251680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.252533 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.252543 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.253029 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.253034 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.253176 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.253890 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.253905 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.255284 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.256998 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.257005 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.257014 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.257338 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.257563 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.257566 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.257568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.257708 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.258153 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.258158 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.258425 (+ 267us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.258576 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.258871 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":7,"spinlock_wait_cycles":384,"thread_start_us":82,"threads_started":1}
I20260810 01:42:22.259959 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.248439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45572 (local address 127.16.58.125:33201)
0810 01:42:22.248813 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.248834 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.248873 (+ 39us) server_negotiation.cc:407] Connection header received
0810 01:42:22.249791 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.249812 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.249983 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.250202 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.250883 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.251889 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.252678 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.253076 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.253176 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.255867 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.255873 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.255881 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.255902 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.257488 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.257884 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.257888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.257889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.257957 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.258209 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.258212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.258214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.258475 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.258670 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.258863 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.258974 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":248,"spinlock_wait_cycles":1792,"thread_start_us":110,"threads_started":1}
I20260810 01:42:22.261247 26679 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.125@KRBTEST.COM for oryx/127.16.58.125@KRBTEST.COM
I20260810 01:42:22.267699 26683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.261684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.0.0.1:45582)
0810 01:42:22.261774 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.261786 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.261853 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.262058 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.262060 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.262179 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.262261 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.262265 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.262867 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.262869 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.263340 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.263346 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.263724 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.263726 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.263788 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.264154 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.264165 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.265239 (+ 1074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.266471 (+ 1232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.266475 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.266477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.266647 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.266874 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.266877 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.266879 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.266948 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.267256 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.267259 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.267335 (+ 76us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.267413 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.267539 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 01:42:22.267722 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.261740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45582 (local address 127.16.58.125:33201)
0810 01:42:22.261837 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.261841 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.261854 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:22.261924 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.261927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.261966 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.262028 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.262340 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.262798 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.263424 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.263649 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.263721 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.265351 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.265354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.265356 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.265375 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.266379 (+ 1004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.266726 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.266730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.266732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.266799 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.267021 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.267024 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.267026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.267172 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.267251 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.267466 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.267590 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":35}
I20260810 01:42:22.270887 26679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: Bootstrap starting.
I20260810 01:42:22.273089 26679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:22.273743 26679 log.cc:824] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:22.275429 26679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: No bootstrap required, opened a new log
I20260810 01:42:22.278388 26679 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } }
I20260810 01:42:22.278574 26679 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:22.278613 26679 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efcb078845c46d09725431e5357e9c5, State: Initialized, Role: FOLLOWER
I20260810 01:42:22.278985 26679 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } }
I20260810 01:42:22.279394 26685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } } }
I20260810 01:42:22.279505 26685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:42:22.280071 26679 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 01:42:22.284408 26704 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:42:22.284492 26704 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:42:22.286901 26583 master_runner.cc:428] Detected that this master 0efcb078845c46d09725431e5357e9c5 is joining an existing cluster
I20260810 01:42:22.286952 26583 master_runner.cc:432] Initiating AddMaster RPC to add 127.16.58.125:33201
I20260810 01:42:22.297257 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.289226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55136 (local address 127.16.58.126:46803)
0810 01:42:22.289346 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.289350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.289364 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:42:22.289404 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.289407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.289452 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.289536 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.289986 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.290585 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.291789 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.292067 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.292163 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.293887 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.293891 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.293894 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.293920 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.295508 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.296063 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.296066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.296069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.296166 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.296461 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.296465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.296467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.296699 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.296795 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.297049 (+ 254us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.297145 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:42:22.297284 26713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.288851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55136)
0810 01:42:22.289145 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.289160 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.289248 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.289563 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.289566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.289747 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.289854 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.289860 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.290711 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.290714 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.291587 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.291595 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.292191 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.292195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.292277 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.293266 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.293282 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.293750 (+ 468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.295607 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.295610 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.295612 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.295949 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.296277 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.296280 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.296282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.296367 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.296787 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.296790 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.296879 (+ 89us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.296982 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.297103 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":123,"threads_started":1}
I20260810 01:42:22.298205 26714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.288860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.0.0.1:45598)
0810 01:42:22.289806 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.289819 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.289913 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.290131 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.290134 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.290348 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.290465 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.290472 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.291463 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.291467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.292458 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.292470 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.292934 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.292937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.293032 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.293397 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.293412 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.293759 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.296347 (+ 2588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.296351 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.296353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.296568 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.296850 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.296853 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.296855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.296923 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.297702 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.297705 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.297786 (+ 81us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.297868 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.298039 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":874,"thread_start_us":88,"threads_started":1}
I20260810 01:42:22.299141 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.289238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45598 (local address 127.16.58.125:33201)
0810 01:42:22.289325 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.289329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.289897 (+ 568us) server_negotiation.cc:407] Connection header received
0810 01:42:22.289985 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.289988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.290026 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.290093 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.290585 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.291343 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.292570 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.292833 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.292922 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.294186 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.294189 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.294192 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.294215 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.296257 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.296665 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.296667 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.296669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.296762 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.297408 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.297412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.297414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.297608 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.297708 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.297939 (+ 231us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.298993 (+ 1054us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":937,"server-negotiator.queue_time_us":34}
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.126@KRBTEST.COM for oryx/127.16.58.125@KRBTEST.COM
I20260810 01:42:22.309585 26682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.301474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45604 (local address 127.16.58.125:33201)
0810 01:42:22.301576 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.301580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.301917 (+ 337us) server_negotiation.cc:407] Connection header received
0810 01:42:22.302084 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.302087 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.302133 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.302207 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.302711 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.303411 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.304241 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.304558 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.304661 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.306727 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.306730 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.306733 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.306757 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.308056 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.308479 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.308482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.308484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.308553 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.308795 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.308798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.308799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.308947 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.309027 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.309348 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.309451 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:42:22.309609 26716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.301421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.0.0.1:45604)
0810 01:42:22.301797 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.301842 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.301969 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.302225 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.302228 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.302522 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.302612 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.302616 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.303493 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.303495 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.304147 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.304156 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.304650 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.304652 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.304725 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.305140 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.305150 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.306594 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.308162 (+ 1568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.308171 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.308177 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.308388 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.308633 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.308636 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.308638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.308718 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.309047 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.309054 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.309167 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.309282 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.309456 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":78,"threads_started":1}
I20260810 01:42:22.310798 25932 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.16.58.125:33201: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "0efcb078845c46d09725431e5357e9c5"
member_type: NON_VOTER
last_known_addr {
host: "127.16.58.125"
port: 33201
}
attrs {
promote: true
}
}
dest_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c"
cas_config_opid_index: -1
I20260810 01:42:22.311517 25932 consensus_queue.cc:237] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } }
I20260810 01:42:22.313397 26717 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 0efcb078845c46d09725431e5357e9c5 (127.16.58.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } } }
I20260810 01:42:22.313961 26641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:22.315094 26717 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.16.58.125:33201
I20260810 01:42:22.315274 26641 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Refusing update from remote peer b897ecaaba574aa4a0fc0e12a3e6e77c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 01:42:22.315508 26583 master.cc:537] Master@127.16.58.125:33201 shutting down...
I20260810 01:42:22.315912 26717 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } } }
I20260810 01:42:22.316017 26717 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:22.316160 26717 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:42:22.318048 25915 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260810 01:42:22.319952 26583 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:22.320248 26583 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:22.320355 26583 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: stopping tablet replica
WARNING: no policy specified for oryx/127.16.58.124@KRBTEST.COM; defaulting to no policy
I20260810 01:42:22.325397 26583 master.cc:552] Master@127.16.58.125:33201 shutdown complete.
I20260810 01:42:22.325446 26583 master_runner.cc:305] Clearing existing system tablet
I20260810 01:42:22.325676 26583 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:22.325732 26583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:22.326579 26716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.326321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.0.0.1:45610)
0810 01:42:22.326442 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.326507 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:33201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 01:42:22.326885 25915 consensus_peers.cc:487] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c -> Peer 0efcb078845c46d09725431e5357e9c5 (127.16.58.125:33201): Couldn't send request to peer 0efcb078845c46d09725431e5357e9c5. Status: Network error: Client connection negotiation failed: client connection to 127.16.58.125:33201: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:42:22.327545 26583 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 01:42:22.328421 26726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.328606 26583 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:22.328799 26583 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:22.328860 26583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal
uuid: "0efcb078845c46d09725431e5357e9c5"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "fa1d934c3c59503ebdeb2ce25da7e7a8"
server_key_iv: "294946b2b8410eab4faaa7dc99bc9471"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.330832 26583 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:22.333168 26583 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 01:42:22.333292 26583 log.cc:1196] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.124@KRBTEST.COM" created.
I20260810 01:42:22.333664 26583 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: Deleting consensus metadata
I20260810 01:42:22.333874 26583 master_runner.cc:315] Copying system tablet from 127.16.58.126:46803
I20260810 01:42:22.335115 26583 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: tablet copy: Beginning tablet copy session from remote peer at address 127.16.58.126:46803
I20260810 01:42:22.347412 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.335735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55144 (local address 127.16.58.126:46803)
0810 01:42:22.335851 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.335855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.340080 (+ 4225us) server_negotiation.cc:407] Connection header received
0810 01:42:22.340207 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.340210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.340260 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.340344 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.340821 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.341634 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.342802 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.343134 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.343241 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.344428 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.344432 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.344435 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.344463 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.345938 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.346387 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.346391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.346393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.346479 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.346730 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.346732 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.346733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.346887 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.346956 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.347217 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.347307 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 01:42:22.347469 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.335701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55144)
0810 01:42:22.339999 (+ 4298us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.340013 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.340120 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.340369 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.340372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.340568 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.340700 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.340707 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.341764 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.341768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.342675 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.342686 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.343246 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.343250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.343343 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.343874 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.343887 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.344283 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.346039 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.346043 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.346045 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.346289 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.346557 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.346560 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.346561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.346654 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.346960 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.346963 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.347056 (+ 93us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.347156 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.347285 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4227,"thread_start_us":108,"threads_started":1}
I20260810 01:42:22.348044 25959 tablet_copy_service.cc:140] P b897ecaaba574aa4a0fc0e12a3e6e77c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 0efcb078845c46d09725431e5357e9c5 ({username='oryx', principal='oryx/127.16.58.125@KRBTEST.COM'} at 127.0.0.1:55144)
I20260810 01:42:22.348219 25959 tablet_copy_service.cc:161] P b897ecaaba574aa4a0fc0e12a3e6e77c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 0efcb078845c46d09725431e5357e9c5 at {username='oryx', principal='oryx/127.16.58.125@KRBTEST.COM'} at 127.0.0.1:55144: session id = 0efcb078845c46d09725431e5357e9c5-00000000000000000000000000000000
I20260810 01:42:22.350028 25959 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:42:22.351686 26583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.124.keytab.
Entry for principal oryx/127.16.58.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.124.keytab.
I20260810 01:42:22.354146 26583 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: tablet copy: Starting download of 0 data blocks...
I20260810 01:42:22.354331 26583 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: tablet copy: Starting download of 1 WAL segments...
I20260810 01:42:22.354421 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.124:40609
--webserver_interface=127.16.58.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.124.keytab
--principal=oryx/127.16.58.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:46803,127.16.58.125:33201,127.16.58.124:40609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:42:22.355885 26583 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:42:22.357276 25959 tablet_copy_service.cc:342] P b897ecaaba574aa4a0fc0e12a3e6e77c: Request end of tablet copy session 0efcb078845c46d09725431e5357e9c5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.16.58.125@KRBTEST.COM'} at 127.0.0.1:55144
I20260810 01:42:22.357385 25959 tablet_copy_service.cc:433] P b897ecaaba574aa4a0fc0e12a3e6e77c: ending tablet copy session 0efcb078845c46d09725431e5357e9c5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 0efcb078845c46d09725431e5357e9c5
I20260810 01:42:22.364509 26583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:22.366060 26741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:22.366145 26742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:22.366335 26745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:22.366654 26583 server_base.cc:1034] running on GCE node
I20260810 01:42:22.366844 26583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:22.367202 26583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:22.368382 26583 hybrid_clock.cc:648] HybridClock initialized: now 1786326142368369 us; error 27 us; skew 500 ppm
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:22.369845 26583 init.cc:377] Logged in from keytab as oryx/127.16.58.125@KRBTEST.COM (short username oryx)
I20260810 01:42:22.370253 26583 webserver.cc:460] Webserver started at http://127.16.58.125:46063/ using document root <none> and password file <none>
I20260810 01:42:22.370434 26583 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:22.370473 26583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:22.371639 26583 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:22.372550 26761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.372797 26583 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 01:42:22.372872 26583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal
uuid: "0efcb078845c46d09725431e5357e9c5"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "fa1d934c3c59503ebdeb2ce25da7e7a8"
server_key_iv: "294946b2b8410eab4faaa7dc99bc9471"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.372942 26583 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:22.378031 26583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:22.379834 26583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:22.384474 26583 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.125:33201
I20260810 01:42:22.385105 26583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
I20260810 01:42:22.385479 26827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.125:33201 every 8 connection(s)
I20260810 01:42:22.386819 26831 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:42:22.387837 26831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: Bootstrap starting.
I20260810 01:42:22.398581 26831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:42:22.399003 26831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: Bootstrap complete.
I20260810 01:42:22.399608 26831 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } }
I20260810 01:42:22.399832 26831 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0efcb078845c46d09725431e5357e9c5, State: Initialized, Role: LEARNER
I20260810 01:42:22.399992 26831 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } }
I20260810 01:42:22.400429 26835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } } }
I20260810 01:42:22.400547 26835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: This master's current role is: LEARNER
I20260810 01:42:22.400619 26831 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:22.404301 26848 catalog_manager.cc:1259] Loaded cluster ID: e41304b9e4724e6bb5d03718aa96a1ba
I20260810 01:42:22.404361 26848 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: loading cluster ID for follower catalog manager: success
I20260810 01:42:22.406417 26848 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: acquiring CA information for follower catalog manager: success
I20260810 01:42:22.407775 26848 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 01:42:22.476163 26737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:22.476406 26737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:22.476500 26737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:22.480394 26737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:22.480444 26737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:22.480463 26737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:22.480525 26737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:22.480557 26737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:22.485772 26737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:46803,127.16.58.125:33201,127.16.58.124:40609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.124.keytab
--principal=oryx/127.16.58.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.124:40609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.58.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:22.486757 26737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:22.487697 26737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:22.495731 26862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:22.495774 26858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:22.495791 26737 server_base.cc:1034] running on GCE node
W20260810 01:42:22.495738 26857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:22.496500 26737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:22.497452 26737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:22.498598 26737 hybrid_clock.cc:648] HybridClock initialized: now 1786326142498571 us; error 37 us; skew 500 ppm
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:22.501251 26737 init.cc:377] Logged in from keytab as oryx/127.16.58.124@KRBTEST.COM (short username oryx)
I20260810 01:42:22.502087 26737 webserver.cc:460] Webserver started at http://127.16.58.124:40773/ using document root <none> and password file <none>
I20260810 01:42:22.502610 26737 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:22.502672 26737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:22.502833 26737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:22.504715 26737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data/instance:
uuid: "360f07cd63094591bb8c500ae0e343d9"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "ccfd36d5d58af0392aa563bafbc12f20"
server_key_iv: "2516169b02d4605562fd124a227d221d"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.505208 26737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal/instance:
uuid: "360f07cd63094591bb8c500ae0e343d9"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "ccfd36d5d58af0392aa563bafbc12f20"
server_key_iv: "2516169b02d4605562fd124a227d221d"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.508471 26737 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:42:22.510600 26869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.511729 26737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:22.511853 26737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal
uuid: "360f07cd63094591bb8c500ae0e343d9"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "ccfd36d5d58af0392aa563bafbc12f20"
server_key_iv: "2516169b02d4605562fd124a227d221d"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.511940 26737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:22.525484 26737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:22.528293 26737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:22.528429 26737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:22.534559 26737 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.124:40609
I20260810 01:42:22.534832 26941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.124:40609 every 8 connection(s)
I20260810 01:42:22.535398 26737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
I20260810 01:42:22.538022 26942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:22.541524 26942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:42:22.542025 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 26737
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.124@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.58.124@KRBTEST.COM
I20260810 01:42:22.554196 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.543358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55146 (local address 127.16.58.126:46803)
0810 01:42:22.543474 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.543477 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.544037 (+ 560us) server_negotiation.cc:407] Connection header received
0810 01:42:22.544868 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.544871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.544919 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.544989 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.546252 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.546751 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.547865 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.548084 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.548164 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.550704 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.550708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.550711 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.550740 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.552022 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.552689 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.552692 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.552693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.552774 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.553127 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.553128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.553136 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.553341 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.553443 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.553969 (+ 526us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.554067 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:42:22.555315 26946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.543396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45622 (local address 127.16.58.124:40609)
0810 01:42:22.543869 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.543887 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.543926 (+ 39us) server_negotiation.cc:407] Connection header received
0810 01:42:22.544662 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.544685 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.544911 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.545952 (+ 1041us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.546060 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.547035 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.547857 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.548244 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.548419 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.551179 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.551185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.551193 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.551214 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.553111 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.553540 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.553546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.553547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.553634 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.553887 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.553890 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.553892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.554142 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.554437 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.554547 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.554671 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":349,"spinlock_wait_cycles":47872,"thread_start_us":132,"threads_started":1}
I20260810 01:42:22.555317 26945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.543396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55146)
0810 01:42:22.543892 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.543939 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.544669 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.545066 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.545074 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.545509 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.546141 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.546153 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.546869 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.546873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.547706 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.547715 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.548217 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.548222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.548412 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.549048 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.549064 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.550552 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.552141 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.552151 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.552160 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.552592 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.552861 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.552864 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.552866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.553045 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.553443 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.553447 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.553741 (+ 294us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.553913 (+ 172us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.554207 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":22,"spinlock_wait_cycles":9984,"thread_start_us":136,"threads_started":1}
I20260810 01:42:22.556555 26942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.124@KRBTEST.COM for oryx/127.16.58.125@KRBTEST.COM
I20260810 01:42:22.563300 26945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.556942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.0.0.1:45620)
0810 01:42:22.557082 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.557094 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.557158 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.557501 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.557503 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.557620 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.557710 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.557714 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.558508 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.558509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.559013 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.559019 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.559392 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.559394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.559455 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.559823 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.559839 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.560882 (+ 1043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.562221 (+ 1339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.562223 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.562224 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.562393 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.562623 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.562625 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.562626 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.562689 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.562969 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.562971 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.563039 (+ 68us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.563109 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.563204 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 01:42:22.563350 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.557065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45620 (local address 127.16.58.125:33201)
0810 01:42:22.557321 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.557324 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.557335 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:42:22.557370 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.557372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.557408 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.557477 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.557793 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.558438 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.559102 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.559316 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.559390 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.561003 (+ 1613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.561007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.561008 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.561043 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.562138 (+ 1095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.562463 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.562466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.562467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.562554 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.562748 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.562750 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.562751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.562903 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.562983 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.563151 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.563237 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":80,"threads_started":1}
I20260810 01:42:22.563949 26942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.124@KRBTEST.COM for oryx/127.16.58.124@KRBTEST.COM
I20260810 01:42:22.569938 26945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.564291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.0.0.1:45628)
0810 01:42:22.564368 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.564380 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.564437 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.564578 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.564580 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.564692 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.564754 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.564758 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.565362 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.565364 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.565824 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.565830 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.566250 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.566253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.566302 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.566603 (+ 301us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.566612 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.567588 (+ 976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.568855 (+ 1267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.568857 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.568858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.569056 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.569256 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.569258 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.569259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.569322 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.569592 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.569594 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.569663 (+ 69us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.569732 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.569824 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 01:42:22.570147 26946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.564340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45628 (local address 127.16.58.124:40609)
0810 01:42:22.564441 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.564444 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.564454 (+ 10us) server_negotiation.cc:407] Connection header received
0810 01:42:22.564481 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.564483 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.564511 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.564571 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.564828 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.565282 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.565932 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.566167 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.566247 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.567704 (+ 1457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.567707 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.567708 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.567729 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.568760 (+ 1031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.569133 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.569135 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.569136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.569196 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.569380 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.569381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.569382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.569534 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.569597 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.569773 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.569875 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":16,"server-negotiator.queue_time_us":43}
I20260810 01:42:22.573042 26942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Bootstrap starting.
I20260810 01:42:22.575162 26942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:22.575865 26942 log.cc:824] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:22.577524 26942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: No bootstrap required, opened a new log
I20260810 01:42:22.580348 26942 raft_consensus.cc:348] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } }
I20260810 01:42:22.580528 26942 raft_consensus.cc:374] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:22.580585 26942 raft_consensus.cc:729] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 360f07cd63094591bb8c500ae0e343d9, State: Initialized, Role: FOLLOWER
I20260810 01:42:22.580972 26942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } }
I20260810 01:42:22.581400 26950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } } }
I20260810 01:42:22.581508 26950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:42:22.582060 26942 sys_catalog.cc:564] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 01:42:22.586347 26966 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:42:22.586422 26966 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:42:22.589514 26737 master_runner.cc:428] Detected that this master 360f07cd63094591bb8c500ae0e343d9 is joining an existing cluster
I20260810 01:42:22.589576 26737 master_runner.cc:432] Initiating AddMaster RPC to add 127.16.58.124:40609
I20260810 01:42:22.608246 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 26019
I20260810 01:42:22.618218 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.591914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.16.58.126:46803)
0810 01:42:22.592036 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.592040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.592670 (+ 630us) server_negotiation.cc:407] Connection header received
0810 01:42:22.592872 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.592875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.592919 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.592981 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.593510 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.594246 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.595320 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.595658 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.595730 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.596999 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.597003 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.597006 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.597032 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.598508 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.616917 (+ 18409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.616921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.616922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.617025 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.617313 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.617316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.617317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.617517 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.617591 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.617941 (+ 350us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.618065 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:42:22.618881 26974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.591897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55150)
0810 01:42:22.592596 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.592608 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.592728 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.593007 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.593010 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.593260 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.593377 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.593384 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.594373 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.594376 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.595201 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.595209 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.595907 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.595910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.596018 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.596463 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.596477 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.596875 (+ 398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.598592 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.598595 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.598597 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.616801 (+ 18204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.617131 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.617134 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.617136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.617222 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.617659 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.617661 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.617748 (+ 87us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.618556 (+ 808us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.618717 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":103,"threads_started":1}
I20260810 01:42:22.620359 26973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.591861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.0.0.1:45632)
0810 01:42:22.592320 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.592335 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.592426 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.592672 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.592675 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.592894 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.593017 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.593024 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.594036 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.594039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.594959 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.594969 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.596079 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.596083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.596176 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.616374 (+ 20198us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.616389 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.616972 (+ 583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.618816 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.618819 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.618821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.619049 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.619338 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.619341 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.619343 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.619425 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.619899 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.619902 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.619994 (+ 92us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.620083 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.620205 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":134,"threads_started":1}
I20260810 01:42:22.620867 26946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.592445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45630 (local address 127.16.58.124:40609)
0810 01:42:22.592525 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.592529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.593323 (+ 794us) server_negotiation.cc:407] Connection header received
0810 01:42:22.593450 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.593453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.593484 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.593523 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.594085 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.595659 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.596668 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.596985 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.597091 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.598313 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.598317 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.598319 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.598343 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.599950 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.619742 (+ 19792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.619745 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.619747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.619839 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.620101 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.620104 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.620106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.620283 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.620345 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.620617 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.620729 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":893,"server-negotiator.queue_time_us":26}
I20260810 01:42:22.621212 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.591902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45632 (local address 127.16.58.125:33201)
0810 01:42:22.592012 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.592017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.592393 (+ 376us) server_negotiation.cc:407] Connection header received
0810 01:42:22.592509 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.592512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.592558 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.592636 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.593127 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.593913 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.595081 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.595437 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.595538 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.617127 (+ 21589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.617130 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.617133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.617157 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.618697 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.619153 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.619156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.619158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.619236 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.619522 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.619526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.619527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.619743 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.619854 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.620773 (+ 919us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.620899 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:42:22.621379 26975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.592413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.0.0.1:45630)
0810 01:42:22.593256 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.593268 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.593370 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.593640 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.593643 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.593867 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.593965 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.593971 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.595763 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.595766 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.596539 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.596551 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.597090 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.597093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.597221 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.597700 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.597715 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.598175 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.600043 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.600046 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.600047 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.619659 (+ 19612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.619927 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.619930 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.619932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.620020 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.620396 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.620399 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.620478 (+ 79us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.621101 (+ 623us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.621218 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":782,"mutex_wait_us":24,"thread_start_us":173,"threads_started":1}
I20260810 01:42:22.623797 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:38325
--local_ip_for_outbound_sockets=127.16.58.65
--tserver_master_addrs=127.16.58.126:46803
--webserver_port=36901
--webserver_interface=127.16.58.65
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab
--principal=oryx/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.16.58.126:46803,127.16.58.125:33201
--tserver_master_addrs=127.16.58.126:46803,127.16.58.125:33201,127.16.58.124:40609 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326141, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.126@KRBTEST.COM for oryx/127.16.58.124@KRBTEST.COM
I20260810 01:42:22.633682 26716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.626688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.0.0.1:45640)
0810 01:42:22.626846 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.626859 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.626938 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.627183 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.627186 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.627344 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.627422 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.627427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.628165 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.628168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.628757 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.628766 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.629161 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.629165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.629258 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.629622 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.629636 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.630851 (+ 1215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.632382 (+ 1531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.632385 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.632387 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.632571 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.632818 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.632822 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.632824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.632901 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.633219 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.633222 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.633310 (+ 88us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.633395 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.633526 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260810 01:42:22.633682 26946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.626743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45640 (local address 127.16.58.124:40609)
0810 01:42:22.626835 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.626839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.626899 (+ 60us) server_negotiation.cc:407] Connection header received
0810 01:42:22.627048 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.627051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.627093 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.627152 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.627521 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.628062 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.628863 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.629063 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.629144 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.630999 (+ 1855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.631003 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.631005 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.631028 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.632282 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.632662 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.632665 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.632667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.632738 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.632977 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.632980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.632982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.633131 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.633213 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.633456 (+ 243us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.633545 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 01:42:22.634764 25932 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.16.58.124:40609: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "360f07cd63094591bb8c500ae0e343d9"
member_type: NON_VOTER
last_known_addr {
host: "127.16.58.124"
port: 40609
}
attrs {
promote: true
}
}
dest_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c"
cas_config_opid_index: 5
I20260810 01:42:22.635280 25932 consensus_queue.cc:237] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } }
I20260810 01:42:22.636325 26719 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 360f07cd63094591bb8c500ae0e343d9 (127.16.58.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.637581 26719 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.16.58.124:40609
I20260810 01:42:22.637758 26719 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.637858 26719 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:22.638348 26737 master.cc:537] Master@127.16.58.124:40609 shutting down...
I20260810 01:42:22.638687 26904 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:22.640304 26904 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 FOLLOWER]: Refusing update from remote peer b897ecaaba574aa4a0fc0e12a3e6e77c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:42:22.641918 26717 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Connected to new peer: Peer: permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:42:22.643697 25916 consensus_peers.cc:487] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c -> Peer 360f07cd63094591bb8c500ae0e343d9 (127.16.58.124:40609): Couldn't send request to peer 360f07cd63094591bb8c500ae0e343d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 01:42:22.643962 26737 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:22.644220 26737 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:22.644325 26737 tablet_replica.cc:330] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: stopping tablet replica
I20260810 01:42:22.648329 26716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.636433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.0.0.1:45636)
0810 01:42:22.642417 (+ 5984us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.642430 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.642508 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.643053 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.643056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.643073 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:22.643158 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.643164 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.645215 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.645218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.646353 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.646364 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.647920 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.647924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.648011 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.648061 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.648138 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.648210 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5916}
I20260810 01:42:22.648753 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.636646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45636 (local address 127.16.58.125:33201)
0810 01:42:22.636822 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.636826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.642746 (+ 5920us) server_negotiation.cc:407] Connection header received
0810 01:42:22.642790 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.642793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.642846 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.642930 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:22.643507 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.645071 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.646486 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.647606 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.647704 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.648547 (+ 843us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.648584 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.648646 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260810 01:42:22.649247 26796 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 LEARNER]: Refusing update from remote peer b897ecaaba574aa4a0fc0e12a3e6e77c: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 01:42:22.649268 26737 master.cc:552] Master@127.16.58.124:40609 shutdown complete.
I20260810 01:42:22.649364 26737 master_runner.cc:305] Clearing existing system tablet
I20260810 01:42:22.649682 26737 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:22.649663 26717 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 01:42:22.649870 26737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:22.651417 26737 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:22.651611 26796 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 360f07cd63094591bb8c500ae0e343d9 (127.16.58.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.652366 26981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.652570 26737 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:22.652681 26737 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:22.652712 26737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal
uuid: "360f07cd63094591bb8c500ae0e343d9"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "ccfd36d5d58af0392aa563bafbc12f20"
server_key_iv: "2516169b02d4605562fd124a227d221d"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.653894 26835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b897ecaaba574aa4a0fc0e12a3e6e77c. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.654034 26835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: This master's current role is: LEARNER
I20260810 01:42:22.654142 26835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: NON_VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: true } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.654212 26835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: This master's current role is: LEARNER
I20260810 01:42:22.654745 26737 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:22.655483 26717 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: attempting to promote NON_VOTER 0efcb078845c46d09725431e5357e9c5 to VOTER
I20260810 01:42:22.655917 26717 consensus_queue.cc:237] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } }
I20260810 01:42:22.657105 26737 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 01:42:22.657186 26737 log.cc:1196] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 01:42:22.657416 26737 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Deleting consensus metadata
I20260810 01:42:22.657480 26716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.656936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.0.0.1:45644)
0810 01:42:22.657354 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.657412 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:40609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353}
I20260810 01:42:22.657582 26737 master_runner.cc:315] Copying system tablet from 127.16.58.126:46803
I20260810 01:42:22.657925 26796 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 LEARNER]: Refusing update from remote peer b897ecaaba574aa4a0fc0e12a3e6e77c: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 01:42:22.658535 26719 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 01:42:22.658681 26737 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: tablet copy: Beginning tablet copy session from remote peer at address 127.16.58.126:46803
I20260810 01:42:22.659166 26716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.658919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.0.0.1:45650)
0810 01:42:22.659051 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.659093 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:40609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260810 01:42:22.659951 25916 consensus_peers.cc:487] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c -> Peer 360f07cd63094591bb8c500ae0e343d9 (127.16.58.124:40609): Couldn't send request to peer 360f07cd63094591bb8c500ae0e343d9. Status: Network error: Client connection negotiation failed: client connection to 127.16.58.124:40609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:42:22.660758 26719 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 0efcb078845c46d09725431e5357e9c5 (127.16.58.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.661224 26796 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 0efcb078845c46d09725431e5357e9c5 (127.16.58.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.662122 26719 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.662225 26719 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:22.662357 26719 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.662453 26719 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:22.662740 26982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.662832 26982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:42:22.669272 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.659693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55154 (local address 127.16.58.126:46803)
0810 01:42:22.659791 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.659795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.660581 (+ 786us) server_negotiation.cc:407] Connection header received
0810 01:42:22.663372 (+ 2791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.663375 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.663416 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.663475 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.663909 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.664422 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.665218 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.665424 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.665507 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.666494 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.666498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.666501 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.666525 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.667776 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.668209 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.668212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.668214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.668288 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.668531 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.668535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.668536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.668707 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.668792 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.669037 (+ 245us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.669135 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:42:22.669299 26990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.659897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55154)
0810 01:42:22.660511 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.660525 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.663277 (+ 2752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.663510 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.663512 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.663700 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.663781 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.663787 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.664520 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.664523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.665105 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.665113 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.665520 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.665523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.665603 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.666054 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.666067 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.666370 (+ 303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.667925 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.667928 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.667930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.668114 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.668369 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.668372 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.668374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.668454 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.668796 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.668799 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.668890 (+ 91us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.668974 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.669109 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":59,"threads_started":1}
I20260810 01:42:22.669847 25959 tablet_copy_service.cc:140] P b897ecaaba574aa4a0fc0e12a3e6e77c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 360f07cd63094591bb8c500ae0e343d9 ({username='oryx', principal='oryx/127.16.58.124@KRBTEST.COM'} at 127.0.0.1:55154)
I20260810 01:42:22.669924 25959 tablet_copy_service.cc:161] P b897ecaaba574aa4a0fc0e12a3e6e77c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 360f07cd63094591bb8c500ae0e343d9 at {username='oryx', principal='oryx/127.16.58.124@KRBTEST.COM'} at 127.0.0.1:55154: session id = 360f07cd63094591bb8c500ae0e343d9-00000000000000000000000000000000
I20260810 01:42:22.670648 25959 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 01:42:22.671646 26737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 01:42:22.673503 26737 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: tablet copy: Starting download of 0 data blocks...
I20260810 01:42:22.673676 26737 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: tablet copy: Starting download of 1 WAL segments...
I20260810 01:42:22.674896 26737 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 01:42:22.676250 25959 tablet_copy_service.cc:342] P b897ecaaba574aa4a0fc0e12a3e6e77c: Request end of tablet copy session 360f07cd63094591bb8c500ae0e343d9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.16.58.124@KRBTEST.COM'} at 127.0.0.1:55154
I20260810 01:42:22.676321 25959 tablet_copy_service.cc:433] P b897ecaaba574aa4a0fc0e12a3e6e77c: ending tablet copy session 360f07cd63094591bb8c500ae0e343d9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 360f07cd63094591bb8c500ae0e343d9
I20260810 01:42:22.682286 26737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:22.683727 26992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:22.683719 26991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:22.684090 26737 server_base.cc:1034] running on GCE node
W20260810 01:42:22.687484 26996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:22.687704 26737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:22.688006 26737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:22.689142 26737 hybrid_clock.cc:648] HybridClock initialized: now 1786326142689130 us; error 27 us; skew 500 ppm
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:22.690522 26737 init.cc:377] Logged in from keytab as oryx/127.16.58.124@KRBTEST.COM (short username oryx)
I20260810 01:42:22.691013 26737 webserver.cc:460] Webserver started at http://127.16.58.124:41759/ using document root <none> and password file <none>
I20260810 01:42:22.691190 26737 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:22.691226 26737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:22.692386 26737 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:22.693226 27004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.693440 26737 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:22.693511 26737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal
uuid: "360f07cd63094591bb8c500ae0e343d9"
format_stamp: "Formatted at 2026-08-10 01:42:22 on dist-test-slave-jlzn"
server_key: "ccfd36d5d58af0392aa563bafbc12f20"
server_key_iv: "2516169b02d4605562fd124a227d221d"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.693586 26737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:22.722533 26737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:22.724444 26737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:22.729024 26737 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.124:40609
I20260810 01:42:22.729043 27084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.124:40609 every 8 connection(s)
I20260810 01:42:22.729542 26737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
I20260810 01:42:22.730945 27085 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:42:22.731783 27085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Bootstrap starting.
I20260810 01:42:22.740155 27085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:42:22.740391 27085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Bootstrap complete.
I20260810 01:42:22.740860 27085 raft_consensus.cc:348] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } }
I20260810 01:42:22.740972 27085 raft_consensus.cc:729] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 360f07cd63094591bb8c500ae0e343d9, State: Initialized, Role: LEARNER
I20260810 01:42:22.741071 27085 consensus_queue.cc:260] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } }
I20260810 01:42:22.741379 27088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:22.741511 27085 sys_catalog.cc:564] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:22.741551 27088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: This master's current role is: LEARNER
I20260810 01:42:22.745568 27105 catalog_manager.cc:1259] Loaded cluster ID: e41304b9e4724e6bb5d03718aa96a1ba
I20260810 01:42:22.745622 27105 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: loading cluster ID for follower catalog manager: success
I20260810 01:42:22.747095 27105 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: acquiring CA information for follower catalog manager: success
I20260810 01:42:22.748212 27105 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 01:42:22.777057 26976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:22.777281 26976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:22.777320 26976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:22.781208 26976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:22.781260 26976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:22.781312 26976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:22.786337 26976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab
--principal=oryx/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:38325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=36901
--tserver_master_addrs=127.16.58.126:46803,127.16.58.125:33201,127.16.58.124:40609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:22.787216 26976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:22.788147 26976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:22.797544 27111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:22.797552 27118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:22.797681 26976 server_base.cc:1034] running on GCE node
W20260810 01:42:22.797556 27114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:22.798152 26976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:22.798771 26976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:22.799927 26976 hybrid_clock.cc:648] HybridClock initialized: now 1786326142799913 us; error 27 us; skew 500 ppm
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:22.802551 26976 init.cc:377] Logged in from keytab as oryx/127.16.58.65@KRBTEST.COM (short username oryx)
I20260810 01:42:22.803363 26976 webserver.cc:460] Webserver started at http://127.16.58.65:36901/ using document root <none> and password file <none>
I20260810 01:42:22.803900 26976 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:22.803999 26976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:22.807484 26976 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:22.809428 27133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.810719 26976 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:22.810832 26976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "b666df6160dc4525abeec7d3d3baf26d"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "235acf67bb3804dff2c6fc505fea4f7e"
server_key_iv: "84b82bc027f97ee2152e59fb305da344"
server_key_version: "encryptionkey@0"
I20260810 01:42:22.811470 26976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:22.827503 26976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:22.830009 26976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:22.830143 26391 heartbeater.cc:503] Master 127.16.58.126:46803 was elected leader, sending a full tablet report...
I20260810 01:42:22.830178 26976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:22.830749 26976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:22.831717 26976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:22.831764 26976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.831830 26976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:22.831863 26976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:22.840168 26976 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:38325
I20260810 01:42:22.840205 27301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:38325 every 8 connection(s)
I20260810 01:42:22.841043 26976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:22.844808 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 26976
I20260810 01:42:22.844995 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 26207
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.124@KRBTEST.COM
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.125@KRBTEST.COM
Aug 10 01:42:22 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326142, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:22.862062 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.842649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:45981 (local address 127.16.58.126:46803)
0810 01:42:22.842768 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.842772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.843967 (+ 1195us) server_negotiation.cc:407] Connection header received
0810 01:42:22.844993 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.844997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.845049 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.845100 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.853293 (+ 8193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.854043 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.855161 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.855492 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.855572 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.858282 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.858285 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.858286 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.858310 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.859590 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.860212 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.860215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.860217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.860298 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.860704 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.860708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.860709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.860914 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.860994 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.861771 (+ 777us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.861895 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:42:22.862064 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.843240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:56089 (local address 127.16.58.124:40609)
0810 01:42:22.843486 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.843490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.844380 (+ 890us) server_negotiation.cc:407] Connection header received
0810 01:42:22.845003 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.845006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.845066 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.845126 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.849913 (+ 4787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.850818 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.851785 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.852096 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.852163 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.855682 (+ 3519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.855685 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.855688 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.855713 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.859443 (+ 3730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.860170 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.860174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.860176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.860269 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.860697 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.860700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.860701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.860914 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.860994 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.861771 (+ 777us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.861895 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":116,"threads_started":1}
I20260810 01:42:22.862139 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.842795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:38673 (local address 127.16.58.125:33201)
0810 01:42:22.842898 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:22.842902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:22.844275 (+ 1373us) server_negotiation.cc:407] Connection header received
0810 01:42:22.844994 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:22.844997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:22.845053 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:22.845100 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:22.847505 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.848603 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.851177 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.851653 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.851753 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.855759 (+ 4006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:22.855765 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:22.855768 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:22.855830 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:22.858435 (+ 2605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.860274 (+ 1839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.860279 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.860281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.860392 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:22.860795 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:22.860800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:22.860802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:22.861062 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:22.861158 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:22.861818 (+ 660us) server_negotiation.cc:299] Negotiation successful
0810 01:42:22.861959 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 01:42:22.863610 27309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.843171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.16.58.65:56089)
0810 01:42:22.844293 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.844306 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.844776 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.845576 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.845580 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.846147 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.846973 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.846997 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.850952 (+ 3955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.850955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.851672 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.851680 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.852295 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.852298 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.852378 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.853034 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.853055 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.855508 (+ 2453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.859572 (+ 4064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.859578 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.859592 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.860040 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.860385 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.860387 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.860389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.860584 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.861066 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.861072 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.861470 (+ 398us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.862223 (+ 753us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.862641 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"mutex_wait_us":440,"spinlock_wait_cycles":6400,"thread_start_us":92,"threads_started":1}
I20260810 01:42:22.863657 27310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.843170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.16.58.65:38673)
0810 01:42:22.844169 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.844182 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.844764 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.845572 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.845579 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.847202 (+ 1623us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.847345 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.847355 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.848844 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.848849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.851015 (+ 2166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.851029 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.852020 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.852027 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.852298 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.853132 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.853150 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.855548 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.859602 (+ 4054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.859607 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.859609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.860134 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.860525 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.860528 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.860531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.860660 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.861230 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.861234 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.861474 (+ 240us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.862822 (+ 1348us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.862995 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":918,"mutex_wait_us":38,"spinlock_wait_cycles":55296,"thread_start_us":128,"threads_started":1}
I20260810 01:42:22.864627 27315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:22.843170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.65:45981)
0810 01:42:22.843832 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:22.843882 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:22.844762 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:22.852847 (+ 8085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:22.852849 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:22.853030 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:22.853143 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.853151 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.854200 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.854203 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.855027 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:22.855038 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:22.855750 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:22.855753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:22.855863 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:22.856644 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:22.856659 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:22.858154 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:22.859724 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.859727 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.859728 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.860111 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.860397 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:22.860400 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:22.860401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:22.860584 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:22.861066 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:22.861072 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:22.861470 (+ 398us) client_negotiation.cc:769] Sending connection context
0810 01:42:22.862372 (+ 902us) client_negotiation.cc:240] Negotiation successful
0810 01:42:22.862580 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":88,"spinlock_wait_cycles":8576,"thread_start_us":137,"threads_started":1}
I20260810 01:42:22.865082 27305 heartbeater.cc:347] Connected to a master server at 127.16.58.125:33201
I20260810 01:42:22.865316 27305 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:22.865780 27305 heartbeater.cc:511] Master 127.16.58.125:33201 requested a full tablet report, sending...
I20260810 01:42:22.866231 27302 heartbeater.cc:347] Connected to a master server at 127.16.58.124:40609
I20260810 01:42:22.866312 27302 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:22.866469 27302 heartbeater.cc:511] Master 127.16.58.124:40609 requested a full tablet report, sending...
I20260810 01:42:22.866824 27303 heartbeater.cc:347] Connected to a master server at 127.16.58.126:46803
I20260810 01:42:22.866899 27303 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:22.867030 27303 heartbeater.cc:511] Master 127.16.58.126:46803 requested a full tablet report, sending...
I20260810 01:42:22.867322 26778 ts_manager.cc:194] Registered new tserver with Master: b666df6160dc4525abeec7d3d3baf26d (127.16.58.65:38325)
I20260810 01:42:22.867527 27021 ts_manager.cc:194] Registered new tserver with Master: b666df6160dc4525abeec7d3d3baf26d (127.16.58.65:38325)
I20260810 01:42:22.868571 25932 ts_manager.cc:194] Re-registered known tserver with Master: b666df6160dc4525abeec7d3d3baf26d (127.16.58.65:38325)
I20260810 01:42:22.869208 25932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:45981
I20260810 01:42:22.883347 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:35995
--local_ip_for_outbound_sockets=127.16.58.66
--tserver_master_addrs=127.16.58.126:46803
--webserver_port=37171
--webserver_interface=127.16.58.66
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab
--principal=oryx/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.16.58.126:46803,127.16.58.125:33201
--tserver_master_addrs=127.16.58.126:46803,127.16.58.125:33201,127.16.58.124:40609 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:22.991077 27317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:22.991295 27317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:22.991340 27317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:22.995420 27317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:22.995471 27317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:22.995536 27317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:23.000455 27317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab
--principal=oryx/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:35995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=37171
--tserver_master_addrs=127.16.58.126:46803,127.16.58.125:33201,127.16.58.124:40609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:23.001363 27317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:23.002290 27317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:23.011207 27322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:23.011191 27323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:23.011261 27317 server_base.cc:1034] running on GCE node
W20260810 01:42:23.011214 27325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:23.011861 27317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:23.012392 27317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:23.013541 27317 hybrid_clock.cc:648] HybridClock initialized: now 1786326143013522 us; error 29 us; skew 500 ppm
Aug 10 01:42:23 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326143, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:23.016079 27317 init.cc:377] Logged in from keytab as oryx/127.16.58.66@KRBTEST.COM (short username oryx)
I20260810 01:42:23.016904 27317 webserver.cc:460] Webserver started at http://127.16.58.66:37171/ using document root <none> and password file <none>
I20260810 01:42:23.017407 27317 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:23.017489 27317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:23.021675 27317 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260810 01:42:23.023830 27337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:23.024955 27317 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:23.025051 27317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "c4ea2580b73a4a12a637936b987c4369"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "983dc48539d89b48311b5798270aa597"
server_key_iv: "91c9e14431b28e410e8d0f2bd69cef6f"
server_key_version: "encryptionkey@0"
I20260810 01:42:23.025568 27317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:23.036983 27317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:23.037866 26575 heartbeater.cc:503] Master 127.16.58.126:46803 was elected leader, sending a full tablet report...
I20260810 01:42:23.039862 27317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:23.040000 27317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:23.040486 27317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:23.041242 27317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:23.041306 27317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:23.041352 27317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:23.041370 27317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:23.049841 27317 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:35995
I20260810 01:42:23.049893 27510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:35995 every 8 connection(s)
I20260810 01:42:23.050801 27317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:23.059099 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 27317
I20260810 01:42:23.059307 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 26401
Aug 10 01:42:23 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326143, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.124@KRBTEST.COM
Aug 10 01:42:23 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326143, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.125@KRBTEST.COM
I20260810 01:42:23.066766 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.052927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:39379 (local address 127.16.58.125:33201)
0810 01:42:23.053051 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.053055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.053607 (+ 552us) server_negotiation.cc:407] Connection header received
0810 01:42:23.054580 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.054583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.054647 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.054695 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.056114 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.056634 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.058648 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.058959 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.059058 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.063319 (+ 4261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.063322 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.063325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.063349 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.064777 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.065278 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.065281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.065282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.065359 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.065694 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.065697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.065698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.065893 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.065947 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.066518 (+ 571us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.066627 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:42:23.067103 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.052512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:34965 (local address 127.16.58.124:40609)
0810 01:42:23.052638 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.052643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.053739 (+ 1096us) server_negotiation.cc:407] Connection header received
0810 01:42:23.054561 (+ 822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.054564 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.054626 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.054716 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.056082 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.056926 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.058691 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.058962 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.059061 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.062324 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.062329 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.062332 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.062363 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.064349 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.065316 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.065320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.065323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.065448 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.065890 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.065894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.065897 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.066175 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.066278 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.066721 (+ 443us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.066922 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:42:23.068338 27516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.052956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.16.58.66:39379)
0810 01:42:23.053462 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.053512 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.054375 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.054889 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.054898 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.055452 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:23.055954 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.055964 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.056779 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.056781 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.058086 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.058095 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.059243 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.059247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.059341 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.061984 (+ 2643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:23.061997 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:23.063186 (+ 1189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:23.064904 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.064906 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.064908 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.065187 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.065447 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.065449 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.065451 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.065604 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.066021 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:23.066026 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:23.066279 (+ 253us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.067036 (+ 757us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.067407 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":80,"spinlock_wait_cycles":14336,"thread_start_us":140,"threads_started":1}
I20260810 01:42:23.068351 27517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.052956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.16.58.66:34965)
0810 01:42:23.053647 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.053661 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.054371 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.054889 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.054898 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.055400 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:23.055947 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.055961 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.057978 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.057982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.058578 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.058586 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.059191 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.059195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.059284 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.059942 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:23.059959 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:23.062112 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:23.064511 (+ 2399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.064517 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.064531 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.065159 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.065631 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.065635 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.065637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.065757 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.066351 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:23.066355 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:23.066460 (+ 105us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.067343 (+ 883us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.067526 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":109,"spinlock_wait_cycles":43776,"thread_start_us":167,"threads_started":1}
I20260810 01:42:23.069790 27511 heartbeater.cc:347] Connected to a master server at 127.16.58.124:40609
I20260810 01:42:23.070099 27511 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:23.070843 27511 heartbeater.cc:511] Master 127.16.58.124:40609 requested a full tablet report, sending...
Aug 10 01:42:23 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326143, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:23.079420 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.052434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:53215 (local address 127.16.58.126:46803)
0810 01:42:23.052561 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.052565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.054072 (+ 1507us) server_negotiation.cc:407] Connection header received
0810 01:42:23.054579 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.054582 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.054638 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.054690 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.056123 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.056931 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.058212 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.058437 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.058523 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.075080 (+ 16557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.075086 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.075089 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.075129 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.077287 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.077901 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.077906 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.077908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.078015 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.078389 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.078392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.078394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.078596 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.078681 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.079083 (+ 402us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.079240 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:42:23.080003 27519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.052956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.66:53215)
0810 01:42:23.053979 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.053991 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.054375 (+ 384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.054903 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.054905 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.055452 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:23.055957 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.055964 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.057041 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.057044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.058093 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.058102 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.058567 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.058570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.058766 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.059419 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:23.059440 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:23.074868 (+ 15428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:23.077446 (+ 2578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.077450 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.077453 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.077760 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.078169 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.078173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.078175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.078288 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.078702 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:23.078706 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:23.078820 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.079602 (+ 782us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.079772 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":941,"mutex_wait_us":256,"spinlock_wait_cycles":22912,"thread_start_us":135,"threads_started":1}
I20260810 01:42:23.080956 27021 ts_manager.cc:194] Registered new tserver with Master: c4ea2580b73a4a12a637936b987c4369 (127.16.58.66:35995)
I20260810 01:42:23.084262 27514 heartbeater.cc:347] Connected to a master server at 127.16.58.125:33201
I20260810 01:42:23.084339 27514 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:23.084501 27514 heartbeater.cc:511] Master 127.16.58.125:33201 requested a full tablet report, sending...
I20260810 01:42:23.084872 27512 heartbeater.cc:347] Connected to a master server at 127.16.58.126:46803
I20260810 01:42:23.084966 27512 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:23.085112 27512 heartbeater.cc:511] Master 127.16.58.126:46803 requested a full tablet report, sending...
I20260810 01:42:23.085206 26778 ts_manager.cc:194] Registered new tserver with Master: c4ea2580b73a4a12a637936b987c4369 (127.16.58.66:35995)
I20260810 01:42:23.085704 25932 ts_manager.cc:194] Re-registered known tserver with Master: c4ea2580b73a4a12a637936b987c4369 (127.16.58.66:35995)
I20260810 01:42:23.086258 25932 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:53215
I20260810 01:42:23.086997 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:40727
--local_ip_for_outbound_sockets=127.16.58.67
--tserver_master_addrs=127.16.58.126:46803
--webserver_port=36871
--webserver_interface=127.16.58.67
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab
--principal=oryx/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.16.58.126:46803,127.16.58.125:33201
--tserver_master_addrs=127.16.58.126:46803,127.16.58.125:33201,127.16.58.124:40609 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:23.195924 27520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:23.196170 27520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:23.196213 27520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:23.200076 27520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:23.200125 27520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:23.200179 27520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:23.205271 27520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab
--principal=oryx/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:40727
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=36871
--tserver_master_addrs=127.16.58.126:46803,127.16.58.125:33201,127.16.58.124:40609
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:23.206162 27520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:23.207065 27520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:23.216200 27535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:23.216228 27537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:23.216396 27534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:23.216475 27520 server_base.cc:1034] running on GCE node
I20260810 01:42:23.216966 27520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:23.217547 27520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:23.218709 27520 hybrid_clock.cc:648] HybridClock initialized: now 1786326143218695 us; error 29 us; skew 500 ppm
Aug 10 01:42:23 dist-test-slave-jlzn krb5kdc[25866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326143, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:23.221292 27520 init.cc:377] Logged in from keytab as oryx/127.16.58.67@KRBTEST.COM (short username oryx)
I20260810 01:42:23.222088 27520 webserver.cc:460] Webserver started at http://127.16.58.67:36871/ using document root <none> and password file <none>
I20260810 01:42:23.222596 27520 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:23.222678 27520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:23.226327 27520 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:23.228258 27549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:23.229413 27520 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:23.229519 27520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "d2a5c24b0baf4b4987ba081c001ca95d"
format_stamp: "Formatted at 2026-08-10 01:42:21 on dist-test-slave-jlzn"
server_key: "dff59f6b71e0a5d4daafd1ed21794c74"
server_key_iv: "ee4851acfe0572034f9e7b38ea22bf5d"
server_key_version: "encryptionkey@0"
I20260810 01:42:23.230154 27520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:23.233767 27551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.229647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.0.0.1:45660)
0810 01:42:23.229951 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.229966 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.230096 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.230498 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.230501 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.230519 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:23.230612 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.230616 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.231676 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.231678 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.232551 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.232563 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.233451 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.233454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.233522 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.233544 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.233587 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.233651 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":68,"threads_started":1}
I20260810 01:42:23.233853 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.229730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45660 (local address 127.16.58.124:40609)
0810 01:42:23.229857 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.229862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.230034 (+ 172us) server_negotiation.cc:407] Connection header received
0810 01:42:23.230213 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.230216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.230278 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.230369 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:23.230747 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.231578 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.232688 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.233342 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.233465 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.233631 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.233668 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.233734 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:42:23.234431 27042 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 01:42:23.234793 27088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b897ecaaba574aa4a0fc0e12a3e6e77c. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:23.234930 27088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: This master's current role is: LEARNER
I20260810 01:42:23.256167 27520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:23.258844 27520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:23.258994 27520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:23.259526 27520 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:23.260388 27520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:23.260435 27520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:23.260474 27520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:23.260495 27520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:23.268734 27520 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:40727
I20260810 01:42:23.268766 27719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:40727 every 8 connection(s)
I20260810 01:42:23.269677 27520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:23.273190 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 27520
Aug 10 01:42:23 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326143, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.125@KRBTEST.COM
Aug 10 01:42:23 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326143, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.124@KRBTEST.COM
Aug 10 01:42:23 dist-test-slave-jlzn krb5kdc[25866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326143, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:23.287380 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.271945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:51277 (local address 127.16.58.125:33201)
0810 01:42:23.272083 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.272086 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.273096 (+ 1010us) server_negotiation.cc:407] Connection header received
0810 01:42:23.273959 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.273963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.274021 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.274074 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.276187 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.276904 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.278654 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.278964 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.279047 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.283443 (+ 4396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.283446 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.283449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.283471 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.284947 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.285571 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.285575 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.285577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.285666 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.286090 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.286094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.286096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.286316 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.286398 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.287103 (+ 705us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.287211 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 01:42:23.287438 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.271465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:55631 (local address 127.16.58.124:40609)
0810 01:42:23.271605 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.271610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.272699 (+ 1089us) server_negotiation.cc:407] Connection header received
0810 01:42:23.274001 (+ 1302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.274004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.274057 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.274109 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.277350 (+ 3241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.278093 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.279254 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.279552 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.279621 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.283775 (+ 4154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.283779 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.283782 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.283829 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.285708 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.286157 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.286161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.286163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.286253 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.286560 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.286564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.286566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.286766 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.286841 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.287170 (+ 329us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.287285 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 01:42:23.289090 27724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.271965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.16.58.67:55631)
0810 01:42:23.272474 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.272525 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.273717 (+ 1192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.274475 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.274484 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.277068 (+ 2584us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:23.277210 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.277218 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.278235 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.278238 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.279111 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.279130 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.279981 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.279985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.280098 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.280989 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:23.281003 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:23.283289 (+ 2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:23.285798 (+ 2509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.285801 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.285803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.286033 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.286367 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.286370 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.286371 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.286459 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.286899 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:23.286902 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:23.286982 (+ 80us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.287651 (+ 669us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.288012 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":138,"threads_started":1}
I20260810 01:42:23.289640 25986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.271392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:38031 (local address 127.16.58.126:46803)
0810 01:42:23.271547 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.271552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.273437 (+ 1885us) server_negotiation.cc:407] Connection header received
0810 01:42:23.273965 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.273969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.274048 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.274108 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.276184 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.276876 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.278712 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.279065 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.279132 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.285840 (+ 6708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.285843 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.285846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.285870 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.287453 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.288032 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.288036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.288037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.288130 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.288436 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.288440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.288441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.288663 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.288747 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.289115 (+ 368us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.289498 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 01:42:23.289934 27727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.271965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.67:38031)
0810 01:42:23.273338 (+ 1373us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.273351 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.273751 (+ 400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.274476 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.274484 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.275170 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:23.276020 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.276033 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.277030 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.277033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.278592 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.278600 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.279479 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.279483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.279561 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.280451 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:23.280466 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:23.285700 (+ 5234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:23.287675 (+ 1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.287677 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.287679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.287933 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.288232 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.288235 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.288237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.288325 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.288811 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:23.288814 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:23.288903 (+ 89us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.289426 (+ 523us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.289561 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1242,"mutex_wait_us":328,"spinlock_wait_cycles":1408,"thread_start_us":107,"threads_started":1}
I20260810 01:42:23.290391 27720 heartbeater.cc:347] Connected to a master server at 127.16.58.124:40609
I20260810 01:42:23.290642 27720 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:23.290674 27738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.275619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45644 (local address 127.16.58.125:33201)
0810 01:42:23.276464 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.276468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.276479 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:42:23.276510 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.276513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.276553 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.276639 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.277578 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.278303 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.279417 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.279742 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.280206 (+ 464us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.281309 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.281313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.281316 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.281342 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.282995 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.283430 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.283433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.283435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.283522 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.286766 (+ 3244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.286770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.286772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.286966 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.287090 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.290394 (+ 3304us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.290513 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":778,"thread_start_us":91,"threads_started":1}
I20260810 01:42:23.291246 27720 heartbeater.cc:511] Master 127.16.58.124:40609 requested a full tablet report, sending...
I20260810 01:42:23.292212 27733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.275185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55168 (local address 127.16.58.126:46803)
0810 01:42:23.275782 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.275786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.276327 (+ 541us) server_negotiation.cc:407] Connection header received
0810 01:42:23.279858 (+ 3531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.279862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.279912 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.279990 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.280842 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.281603 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.282825 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.283186 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.283253 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.287749 (+ 4496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.287753 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.287755 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.287780 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.289394 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.290849 (+ 1455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.290852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.290854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.290947 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.291266 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.291269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.291271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.291505 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.291640 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.291932 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.292056 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":68,"threads_started":1}
I20260810 01:42:23.292254 27726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.271965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.16.58.67:51277)
0810 01:42:23.272992 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.273005 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.273717 (+ 712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.274475 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.274484 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.275169 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:23.276010 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.276031 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.277036 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.277038 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.278519 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.278531 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.279211 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.279216 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.279418 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.280196 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:23.280218 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:23.282909 (+ 2691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:23.285075 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.285081 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.285094 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.285426 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.285776 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:23.285779 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:23.285781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:23.285954 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:23.286471 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:23.286477 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:23.286785 (+ 308us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.287850 (+ 1065us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.288091 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":944,"mutex_wait_us":261,"spinlock_wait_cycles":39296,"thread_start_us":133,"threads_started":1}
I20260810 01:42:23.292340 27721 heartbeater.cc:347] Connected to a master server at 127.16.58.126:46803
I20260810 01:42:23.292424 27721 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:23.292496 27021 ts_manager.cc:194] Registered new tserver with Master: d2a5c24b0baf4b4987ba081c001ca95d (127.16.58.67:40727)
I20260810 01:42:23.292585 27721 heartbeater.cc:511] Master 127.16.58.126:46803 requested a full tablet report, sending...
I20260810 01:42:23.292852 27722 heartbeater.cc:347] Connected to a master server at 127.16.58.125:33201
I20260810 01:42:23.292933 27722 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:23.293104 27722 heartbeater.cc:511] Master 127.16.58.125:33201 requested a full tablet report, sending...
I20260810 01:42:23.293727 26778 ts_manager.cc:194] Registered new tserver with Master: d2a5c24b0baf4b4987ba081c001ca95d (127.16.58.67:40727)
I20260810 01:42:23.294039 25931 ts_manager.cc:194] Re-registered known tserver with Master: d2a5c24b0baf4b4987ba081c001ca95d (127.16.58.67:40727)
I20260810 01:42:23.294750 27745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.276320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45670 (local address 127.16.58.124:40609)
0810 01:42:23.276580 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.276584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.281608 (+ 5024us) server_negotiation.cc:407] Connection header received
0810 01:42:23.281775 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.281778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.281823 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.281880 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.282646 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.283364 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.284601 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.284929 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.285048 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.289189 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.289193 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.289195 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.289218 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.292031 (+ 2813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.293327 (+ 1296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.293331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.293332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.293424 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.293729 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.293733 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.293735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.293998 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.294127 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.294465 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.294586 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":96,"threads_started":1}
I20260810 01:42:23.294801 25931 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:38031
I20260810 01:42:23.296139 25931 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55168:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:23.299111 25931 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:23.301628 27521 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: NON_VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: true } } }
I20260810 01:42:23.301774 27521 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:23.305114 27521 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: attempting to promote NON_VOTER 360f07cd63094591bb8c500ae0e343d9 to VOTER
I20260810 01:42:23.305409 27521 consensus_queue.cc:237] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } }
I20260810 01:42:23.306464 27042 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 LEARNER]: Refusing update from remote peer b897ecaaba574aa4a0fc0e12a3e6e77c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 01:42:23.306789 27521 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Connected to new peer: Peer: permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:42:23.308312 26796 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Refusing update from remote peer b897ecaaba574aa4a0fc0e12a3e6e77c: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 01:42:23.308519 27521 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 360f07cd63094591bb8c500ae0e343d9 (127.16.58.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:23.309422 27042 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 360f07cd63094591bb8c500ae0e343d9 (127.16.58.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:23.309823 27521 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 01:42:23.310106 27521 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:23.310209 27521 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:23.310334 27751 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:23.310434 27751 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:23.311184 27088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:23.311296 27088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:42:23.311700 26796 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 360f07cd63094591bb8c500ae0e343d9 (127.16.58.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:23.313187 27761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:23.313313 27761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:42:23.314841 27751 sys_catalog.cc:455] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:23.314949 27751 sys_catalog.cc:458] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:23.319377 27551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.313633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:35995 (local address 127.0.0.1:48218)
0810 01:42:23.313751 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.313766 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.313832 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.315727 (+ 1895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.315730 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.315744 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:23.315912 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.315923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.317019 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.317022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.317947 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.317958 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.319016 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.319019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.319102 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.319125 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.319182 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.319254 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":33}
I20260810 01:42:23.319432 27763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.313841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.16.58.66:35995)
0810 01:42:23.314181 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.314193 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.314215 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:42:23.314282 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.314288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.314835 (+ 547us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.315892 (+ 1057us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:23.316006 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.316908 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.318106 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.318910 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.319001 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.319157 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.319222 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.319306 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":115,"threads_started":1}
I20260810 01:42:23.320066 27764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.314046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:38325 (local address 127.0.0.1:41410)
0810 01:42:23.314265 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.314278 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.314360 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.316056 (+ 1696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.316059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.316077 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:23.316159 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.316165 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.317664 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.317667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.318611 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.318622 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.319660 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.319664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.319750 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.319775 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.319867 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.319934 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":1,"thread_start_us":97,"threads_started":1}
I20260810 01:42:23.320153 27767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.314810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41410 (local address 127.16.58.65:38325)
0810 01:42:23.315600 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.315617 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.315640 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:42:23.315713 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.315719 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.315916 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.316060 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:23.316278 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.317404 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.318744 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.319555 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.319658 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.319787 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.319909 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.320000 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":689,"thread_start_us":72,"threads_started":1}
I20260810 01:42:23.321084 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.314353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:40727 (local address 127.0.0.1:49854)
0810 01:42:23.314557 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.314569 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.314659 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.315710 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.315714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.315731 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:23.316054 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.316059 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.317491 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.317494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.318658 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.318669 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.320720 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.320723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.320812 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.320837 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.320900 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.320963 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":88,"spinlock_wait_cycles":3328,"thread_start_us":85,"threads_started":1}
I20260810 01:42:23.321955 27766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.314474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49854 (local address 127.16.58.67:40727)
0810 01:42:23.315125 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.315138 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.315159 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:42:23.315228 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.315233 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.315407 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.315564 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:23.316166 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.317373 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.318782 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.319795 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.321547 (+ 1752us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.321690 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.321737 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.321816 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":99,"threads_started":1}
I20260810 01:42:23.322377 27403 tablet_service.cc:1467] Processing CreateTablet for tablet 07864fce312f4f68b3d56bbe2cac8cb7 (DEFAULT_TABLE table=test-table [id=7425a3d6df1743feacd86de18d7cce5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:23.322937 27202 tablet_service.cc:1467] Processing CreateTablet for tablet 07864fce312f4f68b3d56bbe2cac8cb7 (DEFAULT_TABLE table=test-table [id=7425a3d6df1743feacd86de18d7cce5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:23.323484 27403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07864fce312f4f68b3d56bbe2cac8cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:23.323793 27202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07864fce312f4f68b3d56bbe2cac8cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:23.324563 27618 tablet_service.cc:1467] Processing CreateTablet for tablet 07864fce312f4f68b3d56bbe2cac8cb7 (DEFAULT_TABLE table=test-table [id=7425a3d6df1743feacd86de18d7cce5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:23.325521 27618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07864fce312f4f68b3d56bbe2cac8cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:23.332248 27770 tablet_bootstrap.cc:492] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: Bootstrap starting.
I20260810 01:42:23.332711 27772 tablet_bootstrap.cc:492] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: Bootstrap starting.
I20260810 01:42:23.334414 27771 tablet_bootstrap.cc:492] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: Bootstrap starting.
I20260810 01:42:23.334463 27772 tablet_bootstrap.cc:654] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:23.335227 27772 log.cc:824] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:23.336128 27770 tablet_bootstrap.cc:654] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:23.336521 27771 tablet_bootstrap.cc:654] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:23.336819 27770 log.cc:824] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:23.337244 27771 log.cc:824] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:23.338506 27772 tablet_bootstrap.cc:492] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: No bootstrap required, opened a new log
I20260810 01:42:23.338685 27772 ts_tablet_manager.cc:1397] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260810 01:42:23.339013 27771 tablet_bootstrap.cc:492] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: No bootstrap required, opened a new log
I20260810 01:42:23.339187 27771 ts_tablet_manager.cc:1397] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:42:23.341007 27770 tablet_bootstrap.cc:492] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: No bootstrap required, opened a new log
I20260810 01:42:23.341184 27770 ts_tablet_manager.cc:1397] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260810 01:42:23.342948 27772 raft_consensus.cc:348] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } }
I20260810 01:42:23.343220 27772 raft_consensus.cc:374] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:23.343276 27772 raft_consensus.cc:729] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a5c24b0baf4b4987ba081c001ca95d, State: Initialized, Role: FOLLOWER
I20260810 01:42:23.343637 27771 raft_consensus.cc:348] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } }
I20260810 01:42:23.343756 27772 consensus_queue.cc:260] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } }
I20260810 01:42:23.343881 27771 raft_consensus.cc:374] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:23.343941 27771 raft_consensus.cc:729] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b666df6160dc4525abeec7d3d3baf26d, State: Initialized, Role: FOLLOWER
I20260810 01:42:23.344384 27771 consensus_queue.cc:260] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } }
I20260810 01:42:23.344815 27772 ts_tablet_manager.cc:1428] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:42:23.345048 27721 heartbeater.cc:503] Master 127.16.58.126:46803 was elected leader, sending a full tablet report...
I20260810 01:42:23.345264 27771 ts_tablet_manager.cc:1428] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 01:42:23.346236 27770 raft_consensus.cc:348] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } }
I20260810 01:42:23.346519 27770 raft_consensus.cc:374] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:23.346599 27770 raft_consensus.cc:729] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4ea2580b73a4a12a637936b987c4369, State: Initialized, Role: FOLLOWER
I20260810 01:42:23.347005 27770 consensus_queue.cc:260] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } }
I20260810 01:42:23.347270 27303 heartbeater.cc:503] Master 127.16.58.126:46803 was elected leader, sending a full tablet report...
I20260810 01:42:23.347934 27770 ts_tablet_manager.cc:1428] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 01:42:23.348300 27512 heartbeater.cc:503] Master 127.16.58.126:46803 was elected leader, sending a full tablet report...
W20260810 01:42:23.520931 27723 tablet.cc:2369] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:42:23.552522 27515 tablet.cc:2369] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:23.570668 27776 raft_consensus.cc:482] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:23.570869 27776 raft_consensus.cc:504] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } }
I20260810 01:42:23.572018 27776 leader_election.cc:288] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b666df6160dc4525abeec7d3d3baf26d (127.16.58.65:38325), c4ea2580b73a4a12a637936b987c4369 (127.16.58.66:35995)
I20260810 01:42:23.575758 27767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.572337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:40183 (local address 127.16.58.65:38325)
0810 01:42:23.572459 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.572464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.572581 (+ 117us) server_negotiation.cc:407] Connection header received
0810 01:42:23.572673 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.572677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.572726 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.572803 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:23.573088 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.573714 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.574873 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.575265 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.575369 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.575423 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.575582 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.575657 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 01:42:23.575758 27727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.572216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:38325 (local address 127.16.58.67:40183)
0810 01:42:23.572518 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.572529 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.572592 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.572831 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.572833 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.572850 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:23.572954 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.572959 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.573823 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.573827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.574757 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.574767 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.575370 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.575373 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.575473 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.575491 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.575553 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.575620 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":168}
I20260810 01:42:23.575847 27763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.572332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:51065 (local address 127.16.58.66:35995)
0810 01:42:23.572460 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.572464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.572508 (+ 44us) server_negotiation.cc:407] Connection header received
0810 01:42:23.572673 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.572677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.572726 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.572807 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:23.573162 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.573808 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.574928 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.575316 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.575422 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.575470 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.575646 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.575709 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:23.575870 27726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.572216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:35995 (local address 127.16.58.67:51065)
0810 01:42:23.572442 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:23.572457 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:23.572557 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:23.572943 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:23.572946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:23.572967 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:23.573059 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.573065 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.573908 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.573912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.574815 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:23.574825 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.575434 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.575437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:23.575534 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.575555 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:42:23.575617 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 01:42:23.575689 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260810 01:42:23.576483 27231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07864fce312f4f68b3d56bbe2cac8cb7" candidate_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b666df6160dc4525abeec7d3d3baf26d" is_pre_election: true
I20260810 01:42:23.576576 27432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07864fce312f4f68b3d56bbe2cac8cb7" candidate_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4ea2580b73a4a12a637936b987c4369" is_pre_election: true
I20260810 01:42:23.576782 27231 raft_consensus.cc:2454] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a5c24b0baf4b4987ba081c001ca95d in term 0.
I20260810 01:42:23.576833 27432 raft_consensus.cc:2454] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2a5c24b0baf4b4987ba081c001ca95d in term 0.
I20260810 01:42:23.577265 27554 leader_election.cc:302] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b666df6160dc4525abeec7d3d3baf26d, c4ea2580b73a4a12a637936b987c4369, d2a5c24b0baf4b4987ba081c001ca95d; no voters:
I20260810 01:42:23.577533 27776 raft_consensus.cc:2781] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:23.577615 27776 raft_consensus.cc:482] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:23.577646 27776 raft_consensus.cc:3037] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:23.578665 27776 raft_consensus.cc:504] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } }
I20260810 01:42:23.578994 27776 leader_election.cc:288] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [CANDIDATE]: Term 1 election: Requested vote from peers b666df6160dc4525abeec7d3d3baf26d (127.16.58.65:38325), c4ea2580b73a4a12a637936b987c4369 (127.16.58.66:35995)
I20260810 01:42:23.579281 27231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07864fce312f4f68b3d56bbe2cac8cb7" candidate_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b666df6160dc4525abeec7d3d3baf26d"
I20260810 01:42:23.579337 27432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07864fce312f4f68b3d56bbe2cac8cb7" candidate_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4ea2580b73a4a12a637936b987c4369"
I20260810 01:42:23.579389 27231 raft_consensus.cc:3037] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:23.579445 27432 raft_consensus.cc:3037] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:23.580446 27432 raft_consensus.cc:2454] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a5c24b0baf4b4987ba081c001ca95d in term 1.
I20260810 01:42:23.580538 27231 raft_consensus.cc:2454] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2a5c24b0baf4b4987ba081c001ca95d in term 1.
I20260810 01:42:23.580726 27552 leader_election.cc:302] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c4ea2580b73a4a12a637936b987c4369, d2a5c24b0baf4b4987ba081c001ca95d; no voters:
I20260810 01:42:23.580924 27776 raft_consensus.cc:2781] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:23.581099 27776 raft_consensus.cc:686] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 1 LEADER]: Becoming Leader. State: Replica: d2a5c24b0baf4b4987ba081c001ca95d, State: Running, Role: LEADER
I20260810 01:42:23.581413 27776 consensus_queue.cc:237] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } }
I20260810 01:42:23.584730 25932 catalog_manager.cc:5495] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d reported cstate change: term changed from 0 to 1, leader changed from <none> to d2a5c24b0baf4b4987ba081c001ca95d (127.16.58.67). New cstate: current_term: 1 leader_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } health_report { overall_health: HEALTHY } } }
W20260810 01:42:23.592566 27306 tablet.cc:2369] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:23.607270 27766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.603950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49860 (local address 127.16.58.67:40727)
0810 01:42:23.604064 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.604068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.604080 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:23.604224 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.604227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.604282 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.604365 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:23.604614 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.605110 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.605936 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.606159 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.606242 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.606549 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:23.606917 (+ 368us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:23.607019 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.607097 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.607149 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:42:23.612406 27231 raft_consensus.cc:1261] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [term 1 FOLLOWER]: Refusing update from remote peer d2a5c24b0baf4b4987ba081c001ca95d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:23.612406 27432 raft_consensus.cc:1261] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [term 1 FOLLOWER]: Refusing update from remote peer d2a5c24b0baf4b4987ba081c001ca95d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:23.613015 27776 consensus_queue.cc:1035] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:23.613193 27782 consensus_queue.cc:1035] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:23.625406 27786 mvcc.cc:205] Tried to move back new op lower bound from 7316791884230131712 to 7316791884111888384. Current Snapshot: MvccSnapshot[applied={T|T < 7316791884230131712 or (T in {7316791884230131712})}]
I20260810 01:42:23.630415 25931 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:23.630544 25931 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55168:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:23.634840 25931 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b897ecaaba574aa4a0fc0e12a3e6e77c: Sending DeleteTablet for 3 replicas of tablet 07864fce312f4f68b3d56bbe2cac8cb7
I20260810 01:42:23.635852 27403 tablet_service.cc:1514] Processing DeleteTablet for tablet 07864fce312f4f68b3d56bbe2cac8cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:23 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:48218
I20260810 01:42:23.635926 27202 tablet_service.cc:1514] Processing DeleteTablet for tablet 07864fce312f4f68b3d56bbe2cac8cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:23 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:41410
I20260810 01:42:23.636276 27799 tablet_replica.cc:330] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: stopping tablet replica
I20260810 01:42:23.636363 27800 tablet_replica.cc:330] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: stopping tablet replica
I20260810 01:42:23.636655 27800 raft_consensus.cc:2229] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:23.636664 27799 raft_consensus.cc:2229] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:23.636942 27800 raft_consensus.cc:2258] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:23.637094 27799 raft_consensus.cc:2258] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:23.638492 27618 tablet_service.cc:1514] Processing DeleteTablet for tablet 07864fce312f4f68b3d56bbe2cac8cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:23 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:49854
I20260810 01:42:23.638582 27799 ts_tablet_manager.cc:1905] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:23.638939 27800 ts_tablet_manager.cc:1905] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:23.639775 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 25891
I20260810 01:42:23.648504 27800 ts_tablet_manager.cc:1918] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:23.648622 27800 log.cc:1196] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/07864fce312f4f68b3d56bbe2cac8cb7
I20260810 01:42:23.648932 27800 ts_tablet_manager.cc:1939] T 07864fce312f4f68b3d56bbe2cac8cb7 P b666df6160dc4525abeec7d3d3baf26d: Deleting consensus metadata
I20260810 01:42:23.649170 27799 ts_tablet_manager.cc:1918] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:23.649320 27799 log.cc:1196] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/07864fce312f4f68b3d56bbe2cac8cb7
I20260810 01:42:23.649673 27799 ts_tablet_manager.cc:1939] T 07864fce312f4f68b3d56bbe2cac8cb7 P c4ea2580b73a4a12a637936b987c4369: Deleting consensus metadata
I20260810 01:42:23.652424 27802 tablet_replica.cc:330] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: stopping tablet replica
I20260810 01:42:23.652752 27802 raft_consensus.cc:2229] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:23.653117 27802 raft_consensus.cc:2258] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:23.654567 27802 ts_tablet_manager.cc:1905] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 01:42:23.656867 27137 connection.cc:535] server connection from 127.0.0.1:41410 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:42:23.657147 27802 ts_tablet_manager.cc:1918] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:23.657244 27802 log.cc:1196] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/07864fce312f4f68b3d56bbe2cac8cb7
W20260810 01:42:23.657266 27340 connection.cc:535] server connection from 127.0.0.1:48218 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:42:23.657557 27802 ts_tablet_manager.cc:1939] T 07864fce312f4f68b3d56bbe2cac8cb7 P d2a5c24b0baf4b4987ba081c001ca95d: Deleting consensus metadata
W20260810 01:42:23.658496 27552 connection.cc:441] server connection from 127.0.0.1:49854 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49854 (request call id 1) could send its response
I20260810 01:42:23.662961 27738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.637969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45654 (local address 127.16.58.125:33201)
0810 01:42:23.638069 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.638074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.652159 (+ 14085us) server_negotiation.cc:407] Connection header received
0810 01:42:23.652267 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.652270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.652323 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.652400 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.653601 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.654383 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.655604 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.655945 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.656020 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.658146 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.658151 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.658153 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.658180 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.661111 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.661618 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.661622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.661623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.661711 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.661997 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.662000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.662002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.662214 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.662313 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.662677 (+ 364us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.662802 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:42:23.670898 26947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.661413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45662 (local address 127.16.58.125:33201)
0810 01:42:23.661526 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.661530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.662071 (+ 541us) server_negotiation.cc:407] Connection header received
0810 01:42:23.662356 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.662359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.662403 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.662450 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.663273 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.664040 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.665215 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.665532 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.665603 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.667557 (+ 1954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.667562 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.667565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.667590 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.669135 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.669600 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.669603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.669604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.669688 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.670014 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.670017 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.670019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.670237 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.670337 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.670655 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.670758 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:42:23.671703 27307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.661592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45694 (local address 127.16.58.124:40609)
0810 01:42:23.661706 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.661711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.662232 (+ 521us) server_negotiation.cc:407] Connection header received
0810 01:42:23.662384 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.662387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.662432 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.662477 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.664271 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.665034 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.666082 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.666400 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.666478 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.668121 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.668125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.668128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.668156 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.669760 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.670165 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.670168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.670170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.670251 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.670550 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.670554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.670555 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.670770 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.670872 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.671484 (+ 612us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.671592 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:42:23.673640 27745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:23.637708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45678 (local address 127.16.58.124:40609)
0810 01:42:23.637817 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:23.637821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:23.664324 (+ 26503us) server_negotiation.cc:407] Connection header received
0810 01:42:23.664479 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:23.664482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:23.664539 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:23.664585 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:23.665393 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.666187 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.667319 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:23.667676 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:23.667745 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:23.669836 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:23.669840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:23.669842 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:23.669868 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:23.671419 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.672413 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.672416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.672418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.672510 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:23.672823 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:23.672826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:23.672827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:23.673036 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:23.673166 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:23.673410 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 01:42:23.673536 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:42:24.626782 27810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:24.626135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.65:54101)
0810 01:42:24.626567 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:24.626663 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":81,"threads_started":1}
W20260810 01:42:24.627087 27303 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:46803 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
I20260810 01:42:24.627213 27812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:24.626659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.66:47961)
0810 01:42:24.627046 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:24.627117 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":69,"threads_started":1}
I20260810 01:42:24.627228 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:24.626641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.67:35237)
0810 01:42:24.627042 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:24.627130 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":67,"threads_started":1}
W20260810 01:42:24.627476 27721 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:46803 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
W20260810 01:42:24.627573 27512 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:46803 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
I20260810 01:42:25.134999 27813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b897ecaaba574aa4a0fc0e12a3e6e77c)
I20260810 01:42:25.135218 27813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } }
I20260810 01:42:25.135751 27814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b897ecaaba574aa4a0fc0e12a3e6e77c)
I20260810 01:42:25.135950 27814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } }
I20260810 01:42:25.136296 27813 leader_election.cc:288] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b897ecaaba574aa4a0fc0e12a3e6e77c (127.16.58.126:46803), 0efcb078845c46d09725431e5357e9c5 (127.16.58.125:33201)
I20260810 01:42:25.136816 27814 leader_election.cc:288] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b897ecaaba574aa4a0fc0e12a3e6e77c (127.16.58.126:46803), 360f07cd63094591bb8c500ae0e343d9 (127.16.58.124:40609)
I20260810 01:42:25.136922 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.136446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55646)
0810 01:42:25.136733 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.136815 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":86,"threads_started":1}
W20260810 01:42:25.137184 27006 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
I20260810 01:42:25.137507 27820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.136990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55650)
0810 01:42:25.137353 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.137422 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":63,"threads_started":1}
W20260810 01:42:25.137677 26763 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
I20260810 01:42:25.138477 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.138259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55652)
0810 01:42:25.138344 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.138392 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 01:42:25.138677 27822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.138323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55666)
0810 01:42:25.138491 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.138610 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
W20260810 01:42:25.138657 27006 leader_election.cc:334] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b897ecaaba574aa4a0fc0e12a3e6e77c (127.16.58.126:46803): Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
W20260810 01:42:25.138842 26763 leader_election.cc:334] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b897ecaaba574aa4a0fc0e12a3e6e77c (127.16.58.126:46803): Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
I20260810 01:42:25.140623 27819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.136744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45674 (local address 127.16.58.125:33201)
0810 01:42:25.137040 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:25.137045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:25.137263 (+ 218us) server_negotiation.cc:407] Connection header received
0810 01:42:25.137315 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:25.137318 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:25.137364 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:25.137439 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:25.137812 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.138536 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.139680 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.140138 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.140230 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.140288 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:25.140454 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 01:42:25.140521 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":54,"threads_started":1}
I20260810 01:42:25.140625 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.136511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:33201 (local address 127.0.0.1:45674)
0810 01:42:25.137059 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.137072 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:25.137179 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:25.137541 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:25.137545 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:25.137566 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:25.137681 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.137688 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.138669 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.138672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.139563 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.139573 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.140243 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.140246 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.140349 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.140368 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:42:25.140430 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 01:42:25.140499 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":1,"thread_start_us":62,"threads_started":1}
I20260810 01:42:25.140973 27820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.137445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:40609 (local address 127.0.0.1:45700)
0810 01:42:25.137633 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.137645 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:25.137740 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:25.138086 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:25.138089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:25.138107 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:25.138211 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.138217 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.139162 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.139164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.139960 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.139969 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.140598 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.140602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.140700 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.140726 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:42:25.140795 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:42:25.140858 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":76,"threads_started":1}
I20260810 01:42:25.141047 26796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "360f07cd63094591bb8c500ae0e343d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0efcb078845c46d09725431e5357e9c5" is_pre_election: true
I20260810 01:42:25.141245 26796 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 360f07cd63094591bb8c500ae0e343d9 in term 1.
I20260810 01:42:25.141356 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.137143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45700 (local address 127.16.58.124:40609)
0810 01:42:25.137397 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:25.137401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:25.137821 (+ 420us) server_negotiation.cc:407] Connection header received
0810 01:42:25.137867 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:25.137869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:25.137908 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:25.137980 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:25.138329 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.139053 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.140069 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.140497 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.140586 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.140640 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:25.141172 (+ 532us) server_negotiation.cc:299] Negotiation successful
0810 01:42:25.141249 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":156,"thread_start_us":52,"threads_started":1}
I20260810 01:42:25.141601 27008 leader_election.cc:302] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efcb078845c46d09725431e5357e9c5, 360f07cd63094591bb8c500ae0e343d9; no voters: b897ecaaba574aa4a0fc0e12a3e6e77c
I20260810 01:42:25.141824 27813 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 01:42:25.141804 27042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0efcb078845c46d09725431e5357e9c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "360f07cd63094591bb8c500ae0e343d9" is_pre_election: true
I20260810 01:42:25.141889 27813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b897ecaaba574aa4a0fc0e12a3e6e77c)
I20260810 01:42:25.141927 27813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:42:25.143013 27813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } }
I20260810 01:42:25.143242 27042 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0efcb078845c46d09725431e5357e9c5 in current term 2: Already voted for candidate 360f07cd63094591bb8c500ae0e343d9 in this term.
I20260810 01:42:25.143353 27813 leader_election.cc:288] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [CANDIDATE]: Term 2 election: Requested vote from peers b897ecaaba574aa4a0fc0e12a3e6e77c (127.16.58.126:46803), 0efcb078845c46d09725431e5357e9c5 (127.16.58.125:33201)
I20260810 01:42:25.143654 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.143451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55674)
0810 01:42:25.143531 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.143573 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 01:42:25.144129 26768 leader_election.cc:302] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0efcb078845c46d09725431e5357e9c5; no voters: 360f07cd63094591bb8c500ae0e343d9, b897ecaaba574aa4a0fc0e12a3e6e77c
I20260810 01:42:25.144197 26796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "360f07cd63094591bb8c500ae0e343d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0efcb078845c46d09725431e5357e9c5"
I20260810 01:42:25.144307 26796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:42:25.144420 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.144056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55680)
0810 01:42:25.144164 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.144276 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 01:42:25.144512 27006 leader_election.cc:334] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b897ecaaba574aa4a0fc0e12a3e6e77c (127.16.58.126:46803): Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
I20260810 01:42:25.145231 26796 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 360f07cd63094591bb8c500ae0e343d9 in term 2.
I20260810 01:42:25.145337 27814 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:42:25.145524 27008 leader_election.cc:302] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0efcb078845c46d09725431e5357e9c5, 360f07cd63094591bb8c500ae0e343d9; no voters: b897ecaaba574aa4a0fc0e12a3e6e77c
I20260810 01:42:25.145699 27813 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:42:25.145888 27813 raft_consensus.cc:686] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [term 2 LEADER]: Becoming Leader. State: Replica: 360f07cd63094591bb8c500ae0e343d9, State: Running, Role: LEADER
I20260810 01:42:25.146113 27813 consensus_queue.cc:237] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } }
I20260810 01:42:25.147172 27826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 360f07cd63094591bb8c500ae0e343d9. Latest consensus state: current_term: 2 leader_uuid: "360f07cd63094591bb8c500ae0e343d9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:25.147267 27826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:25.147522 27828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:25.149888 27828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:25.150271 27828 catalog_manager.cc:1259] Loaded cluster ID: e41304b9e4724e6bb5d03718aa96a1ba
I20260810 01:42:25.150319 27828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:25.150836 27828 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:25.151206 27828 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Loaded TSK: 0
I20260810 01:42:25.151883 27828 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:42:25.168341 27021 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:25.171303 27021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:25.174037 26796 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [term 2 FOLLOWER]: Refusing update from remote peer 360f07cd63094591bb8c500ae0e343d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260810 01:42:25.174060 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.173789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55700)
0810 01:42:25.173934 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.173980 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 01:42:25.174495 27826 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 01:42:25.174655 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.174448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.0.0.1:55716)
0810 01:42:25.174548 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.174593 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 01:42:25.174787 27006 consensus_peers.cc:487] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 -> Peer b897ecaaba574aa4a0fc0e12a3e6e77c (127.16.58.126:46803): Couldn't send request to peer b897ecaaba574aa4a0fc0e12a3e6e77c. Status: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 01:42:25.175776 27814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 360f07cd63094591bb8c500ae0e343d9. Latest consensus state: current_term: 2 leader_uuid: "360f07cd63094591bb8c500ae0e343d9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:25.175918 27814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:42:25.176865 27813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "360f07cd63094591bb8c500ae0e343d9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:25.176960 27813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:25.177328 27814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "360f07cd63094591bb8c500ae0e343d9" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b897ecaaba574aa4a0fc0e12a3e6e77c" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46803 } } peers { permanent_uuid: "0efcb078845c46d09725431e5357e9c5" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 33201 } attrs { promote: false } } peers { permanent_uuid: "360f07cd63094591bb8c500ae0e343d9" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 40609 } attrs { promote: false } } }
I20260810 01:42:25.177438 27814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efcb078845c46d09725431e5357e9c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:42:25.186264 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.182096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:40727 (local address 127.0.0.1:49868)
0810 01:42:25.182194 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.182207 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:25.182281 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:25.182732 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:25.182735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:25.182749 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:25.182841 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.182846 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.183859 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.183862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.185021 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.185032 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.185906 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.185910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.185991 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.186027 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 01:42:25.186078 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 01:42:25.186141 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":18}
I20260810 01:42:25.187057 27839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.182274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49868 (local address 127.16.58.67:40727)
0810 01:42:25.182508 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:25.182513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:25.182526 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:25.182577 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:25.182580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:25.182640 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:25.182726 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:25.182952 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.183723 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.185150 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.185767 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.186765 (+ 998us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.186821 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:25.186855 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 01:42:25.186929 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":82,"threads_started":1}
I20260810 01:42:25.187108 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.182375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:35995 (local address 127.0.0.1:48220)
0810 01:42:25.182604 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.182618 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:25.182715 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:25.183780 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:25.183784 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:25.183823 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:25.183926 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.183932 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.184806 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.184809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.185824 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.185835 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.186732 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.186735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.186824 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.186850 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:42:25.186933 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 01:42:25.186998 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":2}
I20260810 01:42:25.187530 27618 tablet_service.cc:1467] Processing CreateTablet for tablet f579ddc719754d0eba510a765594cfa0 (DEFAULT_TABLE table=test-table [id=90b0a13156ed438091867f787611ef84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:25.187711 27841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.183061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:38325 (local address 127.0.0.1:41416)
0810 01:42:25.183958 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.183969 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:25.184082 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:25.184328 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:25.184331 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:25.184347 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:25.184425 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.184430 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.185322 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.185326 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.186274 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.186283 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.187345 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.187348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.187430 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.187455 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:42:25.187533 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:42:25.187601 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"thread_start_us":162,"threads_started":1}
I20260810 01:42:25.187747 27842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.183492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41416 (local address 127.16.58.65:38325)
0810 01:42:25.183710 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:25.183713 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:25.184049 (+ 336us) server_negotiation.cc:407] Connection header received
0810 01:42:25.184164 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:25.184167 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:25.184217 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:25.184305 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:25.184517 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.185233 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.186386 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.186848 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.186955 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.187300 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:25.187549 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 01:42:25.187611 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":67,"threads_started":1}
I20260810 01:42:25.187881 27618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f579ddc719754d0eba510a765594cfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:25.187958 27840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.182648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48220 (local address 127.16.58.66:35995)
0810 01:42:25.183571 (+ 923us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:25.183575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:25.183589 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:42:25.183637 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:25.183640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:25.183681 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:25.183774 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:25.184040 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.184709 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.185948 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.186622 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.186722 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.186784 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:25.186954 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 01:42:25.187034 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":847,"thread_start_us":74,"threads_started":1}
I20260810 01:42:25.188205 27202 tablet_service.cc:1467] Processing CreateTablet for tablet f579ddc719754d0eba510a765594cfa0 (DEFAULT_TABLE table=test-table [id=90b0a13156ed438091867f787611ef84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:25.188462 27202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f579ddc719754d0eba510a765594cfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:25.190021 27845 tablet_bootstrap.cc:492] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: Bootstrap starting.
I20260810 01:42:25.190337 27403 tablet_service.cc:1467] Processing CreateTablet for tablet f579ddc719754d0eba510a765594cfa0 (DEFAULT_TABLE table=test-table [id=90b0a13156ed438091867f787611ef84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:25.190619 27403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f579ddc719754d0eba510a765594cfa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:25.190840 27849 tablet_bootstrap.cc:492] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d: Bootstrap starting.
I20260810 01:42:25.191119 27845 tablet_bootstrap.cc:654] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:25.191900 27849 tablet_bootstrap.cc:654] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:25.192422 27845 tablet_bootstrap.cc:492] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: No bootstrap required, opened a new log
I20260810 01:42:25.192508 27845 ts_tablet_manager.cc:1397] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:42:25.192833 27852 tablet_bootstrap.cc:492] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: Bootstrap starting.
I20260810 01:42:25.192971 27845 raft_consensus.cc:348] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } }
I20260810 01:42:25.193118 27845 raft_consensus.cc:374] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:25.193192 27845 raft_consensus.cc:729] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a5c24b0baf4b4987ba081c001ca95d, State: Initialized, Role: FOLLOWER
I20260810 01:42:25.193259 27849 tablet_bootstrap.cc:492] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d: No bootstrap required, opened a new log
I20260810 01:42:25.193338 27849 ts_tablet_manager.cc:1397] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 01:42:25.193337 27845 consensus_queue.cc:260] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } }
I20260810 01:42:25.193670 27845 ts_tablet_manager.cc:1428] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:25.193724 27852 tablet_bootstrap.cc:654] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:25.194891 27852 tablet_bootstrap.cc:492] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: No bootstrap required, opened a new log
I20260810 01:42:25.194972 27852 ts_tablet_manager.cc:1397] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:25.195381 27852 raft_consensus.cc:348] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } }
I20260810 01:42:25.195494 27852 raft_consensus.cc:374] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:25.195529 27852 raft_consensus.cc:729] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4ea2580b73a4a12a637936b987c4369, State: Initialized, Role: FOLLOWER
I20260810 01:42:25.195672 27852 consensus_queue.cc:260] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } }
I20260810 01:42:25.196039 27852 ts_tablet_manager.cc:1428] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:25.196095 27720 heartbeater.cc:503] Master 127.16.58.124:40609 was elected leader, sending a full tablet report...
I20260810 01:42:25.196100 27857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.194340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.67:48431)
0810 01:42:25.195945 (+ 1605us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.196002 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1540,"thread_start_us":99,"threads_started":1}
I20260810 01:42:25.197127 27849 raft_consensus.cc:348] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } }
I20260810 01:42:25.197222 27849 raft_consensus.cc:374] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:25.197250 27849 raft_consensus.cc:729] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b666df6160dc4525abeec7d3d3baf26d, State: Initialized, Role: FOLLOWER
I20260810 01:42:25.197368 27849 consensus_queue.cc:260] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } }
I20260810 01:42:25.197690 27849 ts_tablet_manager.cc:1428] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260810 01:42:25.198769 27863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.196802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.66:46019)
0810 01:42:25.198614 (+ 1812us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.198672 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1746,"thread_start_us":100,"threads_started":1}
I20260810 01:42:25.199596 27511 heartbeater.cc:503] Master 127.16.58.124:40609 was elected leader, sending a full tablet report...
I20260810 01:42:25.199618 27866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.198123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.65:35763)
0810 01:42:25.199473 (+ 1350us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.199529 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1285,"thread_start_us":95,"threads_started":1}
I20260810 01:42:25.200384 27866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.200138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.65:46585)
0810 01:42:25.200258 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.200314 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 01:42:25.251189 27865 raft_consensus.cc:482] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:25.251325 27865 raft_consensus.cc:504] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } }
I20260810 01:42:25.252414 27865 leader_election.cc:288] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a5c24b0baf4b4987ba081c001ca95d (127.16.58.67:40727), c4ea2580b73a4a12a637936b987c4369 (127.16.58.66:35995)
I20260810 01:42:25.255988 27840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.252697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:38659 (local address 127.16.58.66:35995)
0810 01:42:25.252821 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:25.252825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:25.252977 (+ 152us) server_negotiation.cc:407] Connection header received
0810 01:42:25.253105 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:25.253108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:25.253158 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:25.253220 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:25.253483 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.253984 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.255033 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.255431 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.255533 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.255587 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:25.255785 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 01:42:25.255874 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:42:25.255988 27866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.252592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:35995 (local address 127.16.58.65:38659)
0810 01:42:25.252895 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.252908 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:25.253010 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:25.253241 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:25.253244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:25.253260 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:25.253384 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.253389 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.254087 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.254090 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.254915 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.254924 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.255559 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.255563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.255673 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.255691 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 01:42:25.255756 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 01:42:25.255850 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":20}
I20260810 01:42:25.256155 27839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.252711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:48603 (local address 127.16.58.67:40727)
0810 01:42:25.252822 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:25.252826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:25.253062 (+ 236us) server_negotiation.cc:407] Connection header received
0810 01:42:25.253181 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:25.253184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:25.253225 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:25.253287 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:25.253539 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.254086 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.255185 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.255577 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.255682 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.255731 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:25.255952 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 01:42:25.256045 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:42:25.256170 27867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.252592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:40727 (local address 127.16.58.65:48603)
0810 01:42:25.252971 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.252984 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:25.253083 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:25.253307 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:25.253310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:25.253325 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:25.253436 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.253440 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.254250 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.254254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.255059 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:25.255069 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.255689 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.255692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:25.255822 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.255851 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 01:42:25.255915 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 01:42:25.255985 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":64,"thread_start_us":135,"threads_started":1}
I20260810 01:42:25.256373 27432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f579ddc719754d0eba510a765594cfa0" candidate_uuid: "b666df6160dc4525abeec7d3d3baf26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4ea2580b73a4a12a637936b987c4369" is_pre_election: true
I20260810 01:42:25.256515 27432 raft_consensus.cc:2454] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b666df6160dc4525abeec7d3d3baf26d in term 0.
I20260810 01:42:25.256727 27650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f579ddc719754d0eba510a765594cfa0" candidate_uuid: "b666df6160dc4525abeec7d3d3baf26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" is_pre_election: true
I20260810 01:42:25.256893 27134 leader_election.cc:302] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b666df6160dc4525abeec7d3d3baf26d, c4ea2580b73a4a12a637936b987c4369; no voters:
I20260810 01:42:25.256929 27650 raft_consensus.cc:2454] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b666df6160dc4525abeec7d3d3baf26d in term 0.
I20260810 01:42:25.257146 27865 raft_consensus.cc:2781] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:25.257208 27865 raft_consensus.cc:482] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:25.257236 27865 raft_consensus.cc:3037] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:25.258380 27865 raft_consensus.cc:504] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } }
I20260810 01:42:25.258718 27865 leader_election.cc:288] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [CANDIDATE]: Term 1 election: Requested vote from peers d2a5c24b0baf4b4987ba081c001ca95d (127.16.58.67:40727), c4ea2580b73a4a12a637936b987c4369 (127.16.58.66:35995)
I20260810 01:42:25.259075 27650 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f579ddc719754d0eba510a765594cfa0" candidate_uuid: "b666df6160dc4525abeec7d3d3baf26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a5c24b0baf4b4987ba081c001ca95d"
I20260810 01:42:25.259202 27650 raft_consensus.cc:3037] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:25.259217 27432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f579ddc719754d0eba510a765594cfa0" candidate_uuid: "b666df6160dc4525abeec7d3d3baf26d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4ea2580b73a4a12a637936b987c4369"
I20260810 01:42:25.259318 27432 raft_consensus.cc:3037] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:25.260425 27650 raft_consensus.cc:2454] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b666df6160dc4525abeec7d3d3baf26d in term 1.
I20260810 01:42:25.260425 27432 raft_consensus.cc:2454] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b666df6160dc4525abeec7d3d3baf26d in term 1.
I20260810 01:42:25.260681 27137 leader_election.cc:302] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b666df6160dc4525abeec7d3d3baf26d, d2a5c24b0baf4b4987ba081c001ca95d; no voters:
I20260810 01:42:25.260836 27865 raft_consensus.cc:2781] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:25.261046 27865 raft_consensus.cc:686] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 1 LEADER]: Becoming Leader. State: Replica: b666df6160dc4525abeec7d3d3baf26d, State: Running, Role: LEADER
I20260810 01:42:25.261240 27302 heartbeater.cc:503] Master 127.16.58.124:40609 was elected leader, sending a full tablet report...
I20260810 01:42:25.261304 27865 consensus_queue.cc:237] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } }
I20260810 01:42:25.261683 27867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.261446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.65:45829)
0810 01:42:25.261557 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.261611 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 01:42:25.263455 27021 catalog_manager.cc:5495] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d reported cstate change: term changed from 0 to 1, leader changed from <none> to b666df6160dc4525abeec7d3d3baf26d (127.16.58.65). New cstate: current_term: 1 leader_uuid: "b666df6160dc4525abeec7d3d3baf26d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b666df6160dc4525abeec7d3d3baf26d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38325 } health_report { overall_health: HEALTHY } } }
I20260810 01:42:25.284713 27842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.281754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41432 (local address 127.16.58.65:38325)
0810 01:42:25.281864 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:25.281868 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:25.281880 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:25.282009 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:25.282011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:25.282061 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:25.282143 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:25.282326 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.282809 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.283533 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:25.283735 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:25.283813 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:25.284032 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:25.284440 (+ 408us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:25.284521 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:25.284565 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 01:42:25.284608 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:42:25.287237 27432 raft_consensus.cc:1261] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [term 1 FOLLOWER]: Refusing update from remote peer b666df6160dc4525abeec7d3d3baf26d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:25.287449 27650 raft_consensus.cc:1261] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [term 1 FOLLOWER]: Refusing update from remote peer b666df6160dc4525abeec7d3d3baf26d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:25.287750 27865 consensus_queue.cc:1035] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4ea2580b73a4a12a637936b987c4369" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:25.287997 27869 consensus_queue.cc:1035] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a5c24b0baf4b4987ba081c001ca95d" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:25.289577 27857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.289304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.67:38531)
0810 01:42:25.289454 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.289508 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260810 01:42:25.292044 27863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.289303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.66:55439)
0810 01:42:25.291939 (+ 2636us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.291987 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2568}
I20260810 01:42:25.293738 27863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.293466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.66:41267)
0810 01:42:25.293618 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.293673 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 01:42:25.296478 27867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.293330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.65:55135)
0810 01:42:25.296355 (+ 3025us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.296412 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2957}
I20260810 01:42:25.296530 27880 mvcc.cc:205] Tried to move back new op lower bound from 7316791891091640320 to 7316791890992721920. Current Snapshot: MvccSnapshot[applied={T|T < 7316791891091640320}]
I20260810 01:42:25.297780 27857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.297538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:46803 (local address 127.16.58.67:50673)
0810 01:42:25.297650 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.297707 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:46803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 01:42:25.300446 27021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:25.300606 27021 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:25.304278 27021 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 360f07cd63094591bb8c500ae0e343d9: Sending DeleteTablet for 3 replicas of tablet f579ddc719754d0eba510a765594cfa0
I20260810 01:42:25.304940 27403 tablet_service.cc:1514] Processing DeleteTablet for tablet f579ddc719754d0eba510a765594cfa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:25 UTC) from {username='oryx', principal='oryx/127.16.58.124@KRBTEST.COM'} at 127.0.0.1:48220
I20260810 01:42:25.305109 27202 tablet_service.cc:1514] Processing DeleteTablet for tablet f579ddc719754d0eba510a765594cfa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:25 UTC) from {username='oryx', principal='oryx/127.16.58.124@KRBTEST.COM'} at 127.0.0.1:41416
I20260810 01:42:25.305284 27889 tablet_replica.cc:330] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: stopping tablet replica
I20260810 01:42:25.305410 27889 raft_consensus.cc:2229] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:25.305506 27618 tablet_service.cc:1514] Processing DeleteTablet for tablet f579ddc719754d0eba510a765594cfa0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:25 UTC) from {username='oryx', principal='oryx/127.16.58.124@KRBTEST.COM'} at 127.0.0.1:49868
I20260810 01:42:25.305536 27890 tablet_replica.cc:330] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d: stopping tablet replica
I20260810 01:42:25.305534 27889 raft_consensus.cc:2258] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:25.305713 27890 raft_consensus.cc:2229] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:25.305811 27892 tablet_replica.cc:330] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: stopping tablet replica
I20260810 01:42:25.305918 27892 raft_consensus.cc:2229] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:25.306031 27892 raft_consensus.cc:2258] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:25.306149 27890 raft_consensus.cc:2258] T f579ddc719754d0eba510a765594cfa0 P b666df6160dc4525abeec7d3d3baf26d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:25.306416 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 26976
I20260810 01:42:25.316045 27892 ts_tablet_manager.cc:1905] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:25.316187 27889 ts_tablet_manager.cc:1905] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:25.318099 27892 ts_tablet_manager.cc:1918] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:25.318178 27892 log.cc:1196] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/f579ddc719754d0eba510a765594cfa0
I20260810 01:42:25.318431 27892 ts_tablet_manager.cc:1939] T f579ddc719754d0eba510a765594cfa0 P d2a5c24b0baf4b4987ba081c001ca95d: Deleting consensus metadata
I20260810 01:42:25.318583 27889 ts_tablet_manager.cc:1918] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:25.318679 27889 log.cc:1196] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/f579ddc719754d0eba510a765594cfa0
I20260810 01:42:25.318931 27889 ts_tablet_manager.cc:1939] T f579ddc719754d0eba510a765594cfa0 P c4ea2580b73a4a12a637936b987c4369: Deleting consensus metadata
I20260810 01:42:25.319109 27008 catalog_manager.cc:4841] TS d2a5c24b0baf4b4987ba081c001ca95d (127.16.58.67:40727): tablet f579ddc719754d0eba510a765594cfa0 (table test-table [id=90b0a13156ed438091867f787611ef84]) successfully deleted
I20260810 01:42:25.319497 27006 catalog_manager.cc:4841] TS c4ea2580b73a4a12a637936b987c4369 (127.16.58.66:35995): tablet f579ddc719754d0eba510a765594cfa0 (table test-table [id=90b0a13156ed438091867f787611ef84]) successfully deleted
I20260810 01:42:25.322719 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 27317
I20260810 01:42:25.322801 27841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:25.322548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:38325 (local address 127.0.0.1:41442)
0810 01:42:25.322667 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:25.322722 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:38325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 01:42:25.322966 27008 catalog_manager.cc:4584] TS b666df6160dc4525abeec7d3d3baf26d (127.16.58.65:38325): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f579ddc719754d0eba510a765594cfa0: Network error: Client connection negotiation failed: client connection to 127.16.58.65:38325: connect: Connection refused (error 111)
I20260810 01:42:25.333055 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 27520
I20260810 01:42:25.342818 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 26583
I20260810 01:42:25.359099 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 26737
2026-08-10T01:42:25Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5459 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:25 dist-test-slave-jlzn krb5kdc[27896](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:25 dist-test-slave-jlzn krb5kdc[27896](info): set up 2 sockets
Aug 10 01:42:25 dist-test-slave-jlzn krb5kdc[27896](info): commencing operation
krb5kdc: starting...
W20260810 01:42:26.488219 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:26 dist-test-slave-jlzn krb5kdc[27896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:26Z Disabled control of system clock
WARNING: no policy specified for oryx/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.126.keytab.
Entry for principal oryx/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.126.keytab.
I20260810 01:42:26.602339 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:36845
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.126.keytab
--principal=oryx/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:35761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:36845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:26.708232 27917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:26.708462 27917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:26.708499 27917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:26.712354 27917 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:26.712400 27917 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 01:42:26.712416 27917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:26.712432 27917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:26.712453 27917 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:26.712467 27917 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:26.717512 27917 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:35761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:36845
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.126.keytab
--principal=oryx/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:36845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:26.718396 27917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:26.719286 27917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:26.727355 27917 server_base.cc:1034] running on GCE node
W20260810 01:42:26.727305 27925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:26.727321 27922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:26.727306 27923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:26.728156 27917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:26.729137 27917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:26.730289 27917 hybrid_clock.cc:648] HybridClock initialized: now 1786326146730275 us; error 25 us; skew 500 ppm
Aug 10 01:42:26 dist-test-slave-jlzn krb5kdc[27896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326146, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:26.732887 27917 init.cc:377] Logged in from keytab as oryx/127.16.58.126@KRBTEST.COM (short username oryx)
I20260810 01:42:26.733660 27917 webserver.cc:460] Webserver started at http://127.16.58.126:33399/ using document root <none> and password file <none>
I20260810 01:42:26.734122 27917 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:26.734184 27917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:26.734338 27917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:26.736233 27917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "a0fd5959956a41df80b57b212be21dd6"
format_stamp: "Formatted at 2026-08-10 01:42:26 on dist-test-slave-jlzn"
server_key: "f9858cd910b5a7100c2709f42b402bc6"
server_key_iv: "57a384e9113a249f9faca3a2ba480f87"
server_key_version: "encryptionkey@0"
I20260810 01:42:26.736770 27917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "a0fd5959956a41df80b57b212be21dd6"
format_stamp: "Formatted at 2026-08-10 01:42:26 on dist-test-slave-jlzn"
server_key: "f9858cd910b5a7100c2709f42b402bc6"
server_key_iv: "57a384e9113a249f9faca3a2ba480f87"
server_key_version: "encryptionkey@0"
I20260810 01:42:26.740068 27917 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:26.742190 27937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:26.743244 27917 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:26.743351 27917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "a0fd5959956a41df80b57b212be21dd6"
format_stamp: "Formatted at 2026-08-10 01:42:26 on dist-test-slave-jlzn"
server_key: "f9858cd910b5a7100c2709f42b402bc6"
server_key_iv: "57a384e9113a249f9faca3a2ba480f87"
server_key_version: "encryptionkey@0"
I20260810 01:42:26.743438 27917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:26.762049 27917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:26.764451 27917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:26.764621 27917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:26.771757 27917 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:36845
I20260810 01:42:26.771767 28039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:36845 every 8 connection(s)
I20260810 01:42:26.772619 27917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:26.775167 28040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:26.777182 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 27917
I20260810 01:42:26.777302 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:26.777621 16617 external_mini_cluster.cc:1428] Setting key d3afa6f33a9f8d3a260d23de016a01ec
I20260810 01:42:26.781533 28040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: Bootstrap starting.
I20260810 01:42:26.784072 28040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:26.784930 28040 log.cc:824] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:42:26 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326146, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:26.786782 28040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: No bootstrap required, opened a new log
I20260810 01:42:26.790899 28040 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd5959956a41df80b57b212be21dd6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36845 } }
I20260810 01:42:26.791175 28040 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:26.791234 28040 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0fd5959956a41df80b57b212be21dd6, State: Initialized, Role: FOLLOWER
I20260810 01:42:26.791705 28040 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd5959956a41df80b57b212be21dd6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36845 } }
I20260810 01:42:26.791882 28040 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:26.791949 28040 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:26.792039 28040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:26.792063 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:26.778900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53436 (local address 127.16.58.126:36845)
0810 01:42:26.779291 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:26.779310 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:26.779350 (+ 40us) server_negotiation.cc:407] Connection header received
0810 01:42:26.780365 (+ 1015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:26.780388 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:26.780770 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:26.781105 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:26.781768 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:26.783198 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:26.784018 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:26.784697 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:26.784871 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:26.787249 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:26.787256 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:26.787273 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:26.787305 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:26.789170 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:26.789568 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:26.789573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:26.789579 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:26.789722 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:26.789940 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:26.789943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:26.789945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:26.790444 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:26.790650 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:26.790817 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 01:42:26.791104 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":98,"threads_started":1}
I20260810 01:42:26.792881 28040 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd5959956a41df80b57b212be21dd6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36845 } }
I20260810 01:42:26.793226 28040 leader_election.cc:302] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0fd5959956a41df80b57b212be21dd6; no voters:
I20260810 01:42:26.793531 28040 leader_election.cc:288] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:26.793608 28049 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:26.793819 28049 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [term 1 LEADER]: Becoming Leader. State: Replica: a0fd5959956a41df80b57b212be21dd6, State: Running, Role: LEADER
I20260810 01:42:26.794122 28049 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd5959956a41df80b57b212be21dd6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36845 } }
I20260810 01:42:26.794678 28040 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:26.795244 28052 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0fd5959956a41df80b57b212be21dd6. Latest consensus state: current_term: 1 leader_uuid: "a0fd5959956a41df80b57b212be21dd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd5959956a41df80b57b212be21dd6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36845 } } }
I20260810 01:42:26.795390 28052 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:26.795671 28050 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0fd5959956a41df80b57b212be21dd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0fd5959956a41df80b57b212be21dd6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 36845 } } }
I20260810 01:42:26.795773 28050 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6 [sys.catalog]: This master's current role is: LEADER
W20260810 01:42:26.799153 28073 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:42:26.799235 28073 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:42:26.799299 28058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:26.800143 28058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:26.804694 28058 catalog_manager.cc:1347] Generated new cluster ID: 3292de8d8ed34f239633fc9df6381169
I20260810 01:42:26.804750 28058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:26.810391 28058 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:26.811288 28058 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:26.815300 28058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: Generated new TSK 0
I20260810 01:42:26.815853 28058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab.
Entry for principal oryx/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab.
I20260810 01:42:26.842957 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:36845
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab
--principal=oryx/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:35761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:26.952224 28081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:26.952447 28081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:26.952491 28081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:26.956331 28081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:26.956377 28081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:26.956421 28081 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:42:26.956473 28081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:26.961400 28081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:35761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab
--principal=oryx/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.58.126:36845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:26.962286 28081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:26.963195 28081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:26.972038 28092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:26.972049 28091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:26.972049 28097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:26.972342 28081 server_base.cc:1034] running on GCE node
I20260810 01:42:26.972704 28081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:26.973256 28081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:26.974407 28081 hybrid_clock.cc:648] HybridClock initialized: now 1786326146974384 us; error 39 us; skew 500 ppm
Aug 10 01:42:26 dist-test-slave-jlzn krb5kdc[27896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326146, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:26.976954 28081 init.cc:377] Logged in from keytab as oryx/127.16.58.65@KRBTEST.COM (short username oryx)
I20260810 01:42:26.977725 28081 webserver.cc:460] Webserver started at http://127.16.58.65:39541/ using document root <none> and password file <none>
I20260810 01:42:26.978217 28081 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:26.978284 28081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:26.978473 28081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:26.980381 28081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "29bb55af476e4a4ebd867d6085de7824"
format_stamp: "Formatted at 2026-08-10 01:42:26 on dist-test-slave-jlzn"
server_key: "79b973fa1862ee596724e24367589025"
server_key_iv: "4304447e843b0aee25581966ec133f6b"
server_key_version: "encryptionkey@0"
I20260810 01:42:26.980894 28081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "29bb55af476e4a4ebd867d6085de7824"
format_stamp: "Formatted at 2026-08-10 01:42:26 on dist-test-slave-jlzn"
server_key: "79b973fa1862ee596724e24367589025"
server_key_iv: "4304447e843b0aee25581966ec133f6b"
server_key_version: "encryptionkey@0"
I20260810 01:42:26.984251 28081 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:42:26.986426 28107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:26.987524 28081 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:26.987629 28081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "29bb55af476e4a4ebd867d6085de7824"
format_stamp: "Formatted at 2026-08-10 01:42:26 on dist-test-slave-jlzn"
server_key: "79b973fa1862ee596724e24367589025"
server_key_iv: "4304447e843b0aee25581966ec133f6b"
server_key_version: "encryptionkey@0"
I20260810 01:42:26.987717 28081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:27.002784 28081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:27.005352 28081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:27.005522 28081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:27.006845 28081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:27.006894 28081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:27.006948 28081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:27.006978 28081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326146, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:27.017297 28081 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:45569
I20260810 01:42:27.017349 28294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:45569 every 8 connection(s)
I20260810 01:42:27.018169 28081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:27.019465 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.007551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:58769 (local address 127.16.58.126:36845)
0810 01:42:27.007664 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.007668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.008657 (+ 989us) server_negotiation.cc:407] Connection header received
0810 01:42:27.009609 (+ 952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.009613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.009687 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.009781 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:27.010964 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.011788 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.012965 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.013207 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.013295 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.015636 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:27.015639 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:27.015642 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:27.015670 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:27.017272 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.017748 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.017752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.017754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.017838 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.018174 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.018178 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.018180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.018373 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:27.018459 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.019184 (+ 725us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.019309 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:42:27.020179 28123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.008052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36845 (local address 127.16.58.65:58769)
0810 01:42:27.008518 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.008557 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.009368 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.010024 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.010033 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.010388 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:27.010815 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.010828 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.011939 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.011943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.012844 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.012855 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.013357 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.013361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.013532 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.014049 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:27.014068 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:27.015478 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:27.017364 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.017370 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.017383 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.017654 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.017918 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.017921 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.017923 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.018082 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.018473 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:27.018480 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:27.018770 (+ 290us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.018955 (+ 185us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.019251 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":117,"threads_started":1}
I20260810 01:42:27.021282 28295 heartbeater.cc:347] Connected to a master server at 127.16.58.126:36845
I20260810 01:42:27.021422 28295 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:27.021929 28295 heartbeater.cc:511] Master 127.16.58.126:36845 requested a full tablet report, sending...
I20260810 01:42:27.023509 27965 ts_manager.cc:194] Registered new tserver with Master: 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65:45569)
I20260810 01:42:27.024958 27965 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:58769
I20260810 01:42:27.028321 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 28081
I20260810 01:42:27.028432 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:27.028717 16617 external_mini_cluster.cc:1428] Setting key 539359d03248c4734d0ec8694d72ba0f
I20260810 01:42:27.029747 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.023499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:39673 (local address 127.16.58.126:36845)
0810 01:42:27.023611 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.023615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.023835 (+ 220us) server_negotiation.cc:407] Connection header received
0810 01:42:27.023937 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.023941 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.023978 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.024048 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:27.024400 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.025111 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.025910 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.026133 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.026216 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.027157 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:27.027160 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:27.027163 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:27.027187 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:27.028250 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.028671 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.028674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.028676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.028749 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.029014 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.029017 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.029019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.029206 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:27.029298 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.029556 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.029646 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:42:27.029837 28304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.023417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36845 (local address 127.16.58.65:39673)
0810 01:42:27.023743 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.023754 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.023857 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.024057 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.024059 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.024212 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:27.024301 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.024305 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.025215 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.025217 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.025810 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.025819 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.026229 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.026233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.026321 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.026748 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:27.026758 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:27.027037 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:27.028346 (+ 1309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.028349 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.028352 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.028580 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.028853 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.028855 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.028857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.028930 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.029304 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:27.029307 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:27.029404 (+ 97us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.029517 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.029659 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for oryx/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab.
Entry for principal oryx/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab.
I20260810 01:42:27.054499 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:36845
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab
--principal=oryx/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:35761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:27.161952 28308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:27.162184 28308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:27.162225 28308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:27.166054 28308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:27.166097 28308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:27.166137 28308 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:42:27.166173 28308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:27.171172 28308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:35761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab
--principal=oryx/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.58.126:36845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:27.172058 28308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:27.172911 28308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:27.181609 28317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:27.181619 28316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:27.181619 28319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:27.181735 28308 server_base.cc:1034] running on GCE node
I20260810 01:42:27.182199 28308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:27.182750 28308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:27.183859 28308 hybrid_clock.cc:648] HybridClock initialized: now 1786326147183841 us; error 27 us; skew 500 ppm
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326147, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:27.186348 28308 init.cc:377] Logged in from keytab as oryx/127.16.58.66@KRBTEST.COM (short username oryx)
I20260810 01:42:27.187114 28308 webserver.cc:460] Webserver started at http://127.16.58.66:42075/ using document root <none> and password file <none>
I20260810 01:42:27.187600 28308 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:27.187672 28308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:27.187899 28308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:27.189797 28308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62"
format_stamp: "Formatted at 2026-08-10 01:42:27 on dist-test-slave-jlzn"
server_key: "74061d2d7018cb99347c924792702cca"
server_key_iv: "462e0d534d157008fa6bbf4b5e205b34"
server_key_version: "encryptionkey@0"
I20260810 01:42:27.190333 28308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62"
format_stamp: "Formatted at 2026-08-10 01:42:27 on dist-test-slave-jlzn"
server_key: "74061d2d7018cb99347c924792702cca"
server_key_iv: "462e0d534d157008fa6bbf4b5e205b34"
server_key_version: "encryptionkey@0"
I20260810 01:42:27.193904 28308 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:42:27.196220 28330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:27.197312 28308 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:27.197417 28308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62"
format_stamp: "Formatted at 2026-08-10 01:42:27 on dist-test-slave-jlzn"
server_key: "74061d2d7018cb99347c924792702cca"
server_key_iv: "462e0d534d157008fa6bbf4b5e205b34"
server_key_version: "encryptionkey@0"
I20260810 01:42:27.197504 28308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:27.220779 28308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:27.223426 28308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:27.223587 28308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:27.224936 28308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:27.224985 28308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:27.225036 28308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:27.225065 28308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326147, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:27.235211 28308 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:34239
I20260810 01:42:27.235337 28503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:34239 every 8 connection(s)
I20260810 01:42:27.236222 28308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:27.237779 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.225648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:38007 (local address 127.16.58.126:36845)
0810 01:42:27.225760 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.225763 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.226792 (+ 1029us) server_negotiation.cc:407] Connection header received
0810 01:42:27.227751 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.227755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.227851 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.227914 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:27.229238 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.230056 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.231237 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.231527 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.231618 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.234339 (+ 2721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:27.234343 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:27.234346 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:27.234372 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:27.235881 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.236352 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.236356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.236358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.236449 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.236832 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.236836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.236838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.237071 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:27.237158 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.237559 (+ 401us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.237659 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:42:27.238463 28346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.226144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36845 (local address 127.16.58.66:38007)
0810 01:42:27.226653 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.226694 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.227505 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.228333 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.228340 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.228635 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:27.229088 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.229106 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.230197 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.230200 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.231111 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.231128 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.231702 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.231706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.231907 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.232427 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:27.232448 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:27.234191 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:27.235987 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.235991 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.236003 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.236248 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.236543 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.236546 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.236548 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.236718 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.237174 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:27.237180 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:27.237377 (+ 197us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.237520 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.237745 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":132,"threads_started":1}
I20260810 01:42:27.239506 28504 heartbeater.cc:347] Connected to a master server at 127.16.58.126:36845
I20260810 01:42:27.239647 28504 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:27.239904 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 28308
I20260810 01:42:27.240041 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:27.240172 28504 heartbeater.cc:511] Master 127.16.58.126:36845 requested a full tablet report, sending...
I20260810 01:42:27.240371 16617 external_mini_cluster.cc:1428] Setting key 5e2c37075a32e1b31e56b86db85a06e0
I20260810 01:42:27.241179 27967 ts_manager.cc:194] Registered new tserver with Master: 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239)
I20260810 01:42:27.241878 27967 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:38007
I20260810 01:42:27.250046 28513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.241734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36845 (local address 127.16.58.66:33737)
0810 01:42:27.241987 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.242002 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.242082 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.242460 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.242463 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.244014 (+ 1551us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:27.244144 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.244152 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.244871 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.244874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.245551 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.245561 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.246053 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.246056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.246117 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.246593 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:27.246604 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:27.246943 (+ 339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:27.248723 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.248725 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.248727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.248903 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.249167 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.249169 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.249170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.249233 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.249682 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:27.249684 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:27.249752 (+ 68us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.249821 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.249913 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":93,"threads_started":1}
I20260810 01:42:27.250141 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.242160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:33737 (local address 127.16.58.126:36845)
0810 01:42:27.242256 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.242260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.242271 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:42:27.242301 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.242303 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.242341 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.242416 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:27.244264 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.244747 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.245675 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.245961 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.246058 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.247069 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:27.247073 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:27.247076 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:27.247101 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:27.248613 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.248991 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.248995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.248997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.249088 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.249304 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.249307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.249308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.249591 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:27.249702 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.249892 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.249998 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
WARNING: no policy specified for oryx/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab.
Entry for principal oryx/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab.
I20260810 01:42:27.266273 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:36845
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab
--principal=oryx/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:35761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:27.373198 28521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:27.373409 28521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:27.373449 28521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:27.377233 28521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:27.377277 28521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:27.377311 28521 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 01:42:27.377346 28521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:27.382216 28521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:35761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab
--principal=oryx/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.16.58.126:36845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:27.383016 28521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:27.383888 28521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:27.392665 28531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:27.392710 28529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:27.392722 28528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:27.393039 28521 server_base.cc:1034] running on GCE node
I20260810 01:42:27.393406 28521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:27.393956 28521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:27.395133 28521 hybrid_clock.cc:648] HybridClock initialized: now 1786326147395096 us; error 46 us; skew 500 ppm
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326147, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:27.397723 28521 init.cc:377] Logged in from keytab as oryx/127.16.58.67@KRBTEST.COM (short username oryx)
I20260810 01:42:27.398509 28521 webserver.cc:460] Webserver started at http://127.16.58.67:45087/ using document root <none> and password file <none>
I20260810 01:42:27.398990 28521 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:27.399055 28521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:27.399255 28521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:27.401230 28521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "bb4784b7100949219f6bae958ffa6cd9"
format_stamp: "Formatted at 2026-08-10 01:42:27 on dist-test-slave-jlzn"
server_key: "d31b851f6d03eddb8a3ff98dade8e08f"
server_key_iv: "e77e8dc0cffd3a0aed601fa25c020852"
server_key_version: "encryptionkey@0"
I20260810 01:42:27.401736 28521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "bb4784b7100949219f6bae958ffa6cd9"
format_stamp: "Formatted at 2026-08-10 01:42:27 on dist-test-slave-jlzn"
server_key: "d31b851f6d03eddb8a3ff98dade8e08f"
server_key_iv: "e77e8dc0cffd3a0aed601fa25c020852"
server_key_version: "encryptionkey@0"
I20260810 01:42:27.405086 28521 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:27.407184 28545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:27.408285 28521 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:27.408389 28521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "bb4784b7100949219f6bae958ffa6cd9"
format_stamp: "Formatted at 2026-08-10 01:42:27 on dist-test-slave-jlzn"
server_key: "d31b851f6d03eddb8a3ff98dade8e08f"
server_key_iv: "e77e8dc0cffd3a0aed601fa25c020852"
server_key_version: "encryptionkey@0"
I20260810 01:42:27.408473 28521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:27.421186 28521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:27.423599 28521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:27.423758 28521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:27.425096 28521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:27.425153 28521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:27.425202 28521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:27.425230 28521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326147, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:27.435195 28521 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:41821
I20260810 01:42:27.435346 28721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:41821 every 8 connection(s)
I20260810 01:42:27.436050 28521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:27.438186 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.425713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:35985 (local address 127.16.58.126:36845)
0810 01:42:27.425824 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.425827 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.426749 (+ 922us) server_negotiation.cc:407] Connection header received
0810 01:42:27.427621 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.427625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.427685 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.427765 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:27.429291 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.429856 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.431055 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.431394 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.431525 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.434682 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:27.434686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:27.434689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:27.434718 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:27.436241 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.436781 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.436785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.436787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.436877 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.437183 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.437186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.437188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.437365 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:27.437451 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.437899 (+ 448us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.438017 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:42:27.438822 28562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.426168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36845 (local address 127.16.58.67:35985)
0810 01:42:27.426612 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.426657 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.427434 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.428057 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.428066 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.428510 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:27.429143 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.429164 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.429976 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.429980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.430911 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.430921 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.431561 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.431566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.431735 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.432275 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:27.432295 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:27.434520 (+ 2225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:27.436350 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.436355 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.436368 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.436697 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.436958 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.436961 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.436963 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.437093 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.437464 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:27.437470 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:27.437687 (+ 217us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.437836 (+ 149us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.438107 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":124,"threads_started":1}
I20260810 01:42:27.439970 28723 heartbeater.cc:347] Connected to a master server at 127.16.58.126:36845
I20260810 01:42:27.440101 28723 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:27.440557 28723 heartbeater.cc:511] Master 127.16.58.126:36845 requested a full tablet report, sending...
I20260810 01:42:27.441298 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 28521
I20260810 01:42:27.441411 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:27.441705 16617 external_mini_cluster.cc:1428] Setting key f931af354729c7f1a015d3a787c2caa5
I20260810 01:42:27.442224 27965 ts_manager.cc:194] Registered new tserver with Master: bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821)
I20260810 01:42:27.442770 27965 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:35985
I20260810 01:42:27.444749 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:42:27.448501 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.441891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:54863 (local address 127.16.58.126:36845)
0810 01:42:27.441995 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.441999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.442169 (+ 170us) server_negotiation.cc:407] Connection header received
0810 01:42:27.442263 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.442266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.442309 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.442374 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:27.442761 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.443425 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.444436 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.444735 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.444825 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.445781 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:27.445785 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:27.445787 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:27.445812 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:27.447003 (+ 1191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.447381 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.447384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.447386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.447462 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.447717 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.447721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.447723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.447935 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:27.448021 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.448263 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.448360 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:42:27.448511 28729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.441832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36845 (local address 127.16.58.67:54863)
0810 01:42:27.442091 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.442102 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.442193 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.442389 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.442392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.442560 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:27.442654 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.442659 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.443560 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.443564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.444329 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.444339 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.444839 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.444843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.444933 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.445351 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:27.445361 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:27.445660 (+ 299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:27.447098 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.447102 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.447104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.447295 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.447541 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.447544 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.447545 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.447633 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.448022 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:27.448025 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:27.448111 (+ 86us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.448200 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.448329 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":54,"thread_start_us":118,"threads_started":1}
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326147, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 01:42:27.468235 28045 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:27.463032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53442 (local address 127.16.58.126:36845)
0810 01:42:27.463154 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.463157 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.463169 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:27.463202 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.463204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.463238 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.463302 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:27.463920 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.464415 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.465175 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.465366 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.465429 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.468111 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53442: BlockingRecv error: recv got EOF from 127.0.0.1:53442 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326147, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:27.476130 28045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.469407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53456 (local address 127.16.58.126:36845)
0810 01:42:27.469523 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.469527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.469617 (+ 90us) server_negotiation.cc:407] Connection header received
0810 01:42:27.469735 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.469738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.469775 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.469834 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:27.470393 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.470858 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.471645 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.471889 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.471970 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.473879 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:27.473882 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:27.473883 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:27.473905 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:27.474926 (+ 1021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.475264 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.475266 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.475267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.475329 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.475503 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.475504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.475505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.475650 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:27.475744 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.475926 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.476020 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:42:27.478518 27965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:27.481848 27965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:27.495668 28758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.490359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34239 (local address 127.0.0.1:40580)
0810 01:42:27.491316 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.491328 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.491407 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.492147 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.492150 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.492168 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:27.492269 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.492276 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.493183 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.493187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.494240 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.494250 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.495129 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.495133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.495252 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.495293 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.495410 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.495526 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":4,"thread_start_us":98,"threads_started":1}
I20260810 01:42:27.495708 28764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.491061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40580 (local address 127.16.58.66:34239)
0810 01:42:27.491703 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.491714 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.491734 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:42:27.491840 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.491846 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.492026 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.492170 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:27.492380 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.493078 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.494376 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.495016 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.495110 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.495319 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.495439 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.495525 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":114,"threads_started":1}
I20260810 01:42:27.496011 28753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.490168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:41821 (local address 127.0.0.1:42212)
0810 01:42:27.490774 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.490822 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.490938 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.491735 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.491741 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.491766 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:27.491933 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.491941 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.493335 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.493339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.494532 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.494541 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.495594 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.495597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.495678 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.495702 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.495783 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.495879 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"mutex_wait_us":2,"thread_start_us":78,"threads_started":1}
I20260810 01:42:27.496690 28761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.490815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42212 (local address 127.16.58.67:41821)
0810 01:42:27.491264 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.491277 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.491299 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:42:27.491376 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.491380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.491581 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.491726 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:27.492051 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.493209 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.494675 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.495478 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.496270 (+ 792us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.496421 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.496470 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.496553 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":106,"threads_started":1}
I20260810 01:42:27.496959 28762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.490988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60782 (local address 127.16.58.65:45569)
0810 01:42:27.491265 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.491278 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.492135 (+ 857us) server_negotiation.cc:407] Connection header received
0810 01:42:27.492219 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.492224 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.492474 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.492605 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:27.492990 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.494150 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.495586 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.496372 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.496478 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.496617 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.496735 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.496823 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":87,"threads_started":1}
I20260810 01:42:27.497478 28755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.490592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:45569 (local address 127.0.0.1:60782)
0810 01:42:27.491951 (+ 1359us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.491962 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.492045 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.492758 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.492761 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.492778 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:27.492872 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.492878 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.494270 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.494274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.495453 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.495465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.496494 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.496498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.496596 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.496620 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.496706 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.496910 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1305,"thread_start_us":84,"threads_started":1}
I20260810 01:42:27.498783 28404 tablet_service.cc:1467] Processing CreateTablet for tablet edea94f15dda4ba382539dd0b44b2c69 (DEFAULT_TABLE table=test-table [id=4ca2170f560143879eba6d49924ab8d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:27.499701 28404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edea94f15dda4ba382539dd0b44b2c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:27.499733 28199 tablet_service.cc:1467] Processing CreateTablet for tablet edea94f15dda4ba382539dd0b44b2c69 (DEFAULT_TABLE table=test-table [id=4ca2170f560143879eba6d49924ab8d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:27.500689 28199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edea94f15dda4ba382539dd0b44b2c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:27.505235 28625 tablet_service.cc:1467] Processing CreateTablet for tablet edea94f15dda4ba382539dd0b44b2c69 (DEFAULT_TABLE table=test-table [id=4ca2170f560143879eba6d49924ab8d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:27.506078 28625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edea94f15dda4ba382539dd0b44b2c69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:27.506696 28765 tablet_bootstrap.cc:492] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: Bootstrap starting.
I20260810 01:42:27.508663 28766 tablet_bootstrap.cc:492] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Bootstrap starting.
I20260810 01:42:27.508723 28765 tablet_bootstrap.cc:654] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:27.509550 28765 log.cc:824] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:27.510602 28766 tablet_bootstrap.cc:654] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:27.511456 28766 log.cc:824] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:27.512051 28765 tablet_bootstrap.cc:492] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: No bootstrap required, opened a new log
I20260810 01:42:27.512228 28765 ts_tablet_manager.cc:1397] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:42:27.513337 28775 tablet_bootstrap.cc:492] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: Bootstrap starting.
I20260810 01:42:27.513442 28766 tablet_bootstrap.cc:492] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: No bootstrap required, opened a new log
I20260810 01:42:27.513619 28766 ts_tablet_manager.cc:1397] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:42:27.514916 28775 tablet_bootstrap.cc:654] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:27.515530 28775 log.cc:824] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:27.516026 28765 raft_consensus.cc:348] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } }
I20260810 01:42:27.516281 28765 raft_consensus.cc:374] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:27.516332 28765 raft_consensus.cc:729] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29bb55af476e4a4ebd867d6085de7824, State: Initialized, Role: FOLLOWER
I20260810 01:42:27.517042 28765 consensus_queue.cc:260] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } }
I20260810 01:42:27.517244 28766 raft_consensus.cc:348] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } }
I20260810 01:42:27.517472 28775 tablet_bootstrap.cc:492] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: No bootstrap required, opened a new log
I20260810 01:42:27.517486 28766 raft_consensus.cc:374] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:27.517535 28766 raft_consensus.cc:729] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d9c4563a0c406ab9d3ac7b2ebcdb62, State: Initialized, Role: FOLLOWER
I20260810 01:42:27.517663 28775 ts_tablet_manager.cc:1397] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260810 01:42:27.517875 28295 heartbeater.cc:503] Master 127.16.58.126:36845 was elected leader, sending a full tablet report...
I20260810 01:42:27.517925 28766 consensus_queue.cc:260] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } }
I20260810 01:42:27.518090 28765 ts_tablet_manager.cc:1428] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:42:27.518846 28766 ts_tablet_manager.cc:1428] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent starting tablet: real 0.005s user 0.002s sys 0.004s
I20260810 01:42:27.518875 28504 heartbeater.cc:503] Master 127.16.58.126:36845 was elected leader, sending a full tablet report...
W20260810 01:42:27.519167 28296 tablet.cc:2369] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:27.521822 28775 raft_consensus.cc:348] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } }
I20260810 01:42:27.522009 28775 raft_consensus.cc:374] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:27.522071 28775 raft_consensus.cc:729] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4784b7100949219f6bae958ffa6cd9, State: Initialized, Role: FOLLOWER
I20260810 01:42:27.522470 28775 consensus_queue.cc:260] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } }
I20260810 01:42:27.523099 28723 heartbeater.cc:503] Master 127.16.58.126:36845 was elected leader, sending a full tablet report...
I20260810 01:42:27.523272 28775 ts_tablet_manager.cc:1428] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:42:27.651412 28777 raft_consensus.cc:482] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:27.651641 28777 raft_consensus.cc:504] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } }
I20260810 01:42:27.652808 28777 leader_election.cc:288] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821), 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239)
I20260810 01:42:27.656533 28761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.653154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:39677 (local address 127.16.58.67:41821)
0810 01:42:27.653279 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.653283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.653449 (+ 166us) server_negotiation.cc:407] Connection header received
0810 01:42:27.653569 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.653573 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.653621 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.653683 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:27.653994 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.654527 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.655596 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.656039 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.656160 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.656208 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.656368 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.656432 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:42:27.656529 28784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.653067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34239 (local address 127.16.58.65:60369)
0810 01:42:27.653415 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.653428 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.653533 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.653787 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.653789 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.653803 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:27.653923 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.653928 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.654651 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.654654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.655461 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.655470 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.656116 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.656120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.656212 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.656236 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.656297 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.656361 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":20,"thread_start_us":62,"threads_started":1}
I20260810 01:42:27.656529 28764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.653217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:60369 (local address 127.16.58.66:34239)
0810 01:42:27.653347 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.653351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.653504 (+ 153us) server_negotiation.cc:407] Connection header received
0810 01:42:27.653621 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.653623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.653690 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.653765 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:27.654026 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.654542 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.655576 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.656005 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.656095 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.656151 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.656325 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.656397 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:42:27.656548 28782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.653017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:41821 (local address 127.16.58.65:39677)
0810 01:42:27.653361 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.653375 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.653471 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.653711 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.653714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.653730 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:27.653890 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.653897 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.654632 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.654636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.655478 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.655487 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.656163 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.656167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.656253 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.656271 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.656344 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.656406 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":62,"thread_start_us":103,"threads_started":1}
I20260810 01:42:27.657106 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edea94f15dda4ba382539dd0b44b2c69" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" is_pre_election: true
I20260810 01:42:27.657109 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edea94f15dda4ba382539dd0b44b2c69" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9" is_pre_election: true
I20260810 01:42:27.657362 28431 raft_consensus.cc:2454] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 0.
I20260810 01:42:27.657370 28656 raft_consensus.cc:2454] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 0.
I20260810 01:42:27.657814 28111 leader_election.cc:302] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29bb55af476e4a4ebd867d6085de7824, bb4784b7100949219f6bae958ffa6cd9; no voters:
I20260810 01:42:27.658077 28777 raft_consensus.cc:2781] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:27.658160 28777 raft_consensus.cc:482] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:27.658190 28777 raft_consensus.cc:3037] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:27.659198 28777 raft_consensus.cc:504] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } }
I20260810 01:42:27.659509 28777 leader_election.cc:288] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 election: Requested vote from peers bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821), 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239)
I20260810 01:42:27.659866 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edea94f15dda4ba382539dd0b44b2c69" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9"
I20260810 01:42:27.659873 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edea94f15dda4ba382539dd0b44b2c69" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62"
I20260810 01:42:27.659984 28656 raft_consensus.cc:3037] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:27.659986 28431 raft_consensus.cc:3037] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:27.661227 28656 raft_consensus.cc:2454] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 1.
I20260810 01:42:27.661227 28431 raft_consensus.cc:2454] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 1.
I20260810 01:42:27.661513 28111 leader_election.cc:302] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 13d9c4563a0c406ab9d3ac7b2ebcdb62, 29bb55af476e4a4ebd867d6085de7824, bb4784b7100949219f6bae958ffa6cd9; no voters:
I20260810 01:42:27.661684 28777 raft_consensus.cc:2781] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:27.661875 28777 raft_consensus.cc:686] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 1 LEADER]: Becoming Leader. State: Replica: 29bb55af476e4a4ebd867d6085de7824, State: Running, Role: LEADER
I20260810 01:42:27.662206 28777 consensus_queue.cc:237] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } }
I20260810 01:42:27.665180 27967 catalog_manager.cc:5495] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65). New cstate: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } health_report { overall_health: HEALTHY } } }
I20260810 01:42:27.685369 28762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.682193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60798 (local address 127.16.58.65:45569)
0810 01:42:27.682312 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.682316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.682329 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:27.682480 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.682482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.682531 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.682615 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:27.682862 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.683344 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.684210 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.684422 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.684496 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.684699 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:27.685070 (+ 371us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:27.685160 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.685205 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.685250 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 01:42:27.687191 28724 tablet.cc:2369] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:27.690644 28656 raft_consensus.cc:1261] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Refusing update from remote peer 29bb55af476e4a4ebd867d6085de7824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:27.690657 28431 raft_consensus.cc:1261] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Refusing update from remote peer 29bb55af476e4a4ebd867d6085de7824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:27.691279 28785 consensus_queue.cc:1035] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:27.691445 28777 consensus_queue.cc:1035] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:27.697727 28790 mvcc.cc:205] Tried to move back new op lower bound from 7316791900934447104 to 7316791900826779648. Current Snapshot: MvccSnapshot[applied={T|T < 7316791900934447104}]
I20260810 01:42:27.698817 28789 mvcc.cc:205] Tried to move back new op lower bound from 7316791900934447104 to 7316791900826779648. Current Snapshot: MvccSnapshot[applied={T|T < 7316791900934447104}]
I20260810 01:42:27.703446 28796 mvcc.cc:205] Tried to move back new op lower bound from 7316791900934447104 to 7316791900826779648. Current Snapshot: MvccSnapshot[applied={T|T < 7316791900934447104 or (T in {7316791900934447104})}]
I20260810 01:42:27.705896 27967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:27.706022 27967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:27.708155 27967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: Sending DeleteTablet for 3 replicas of tablet edea94f15dda4ba382539dd0b44b2c69
I20260810 01:42:27.708827 28404 tablet_service.cc:1514] Processing DeleteTablet for tablet edea94f15dda4ba382539dd0b44b2c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:27 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:40580
I20260810 01:42:27.708827 28625 tablet_service.cc:1514] Processing DeleteTablet for tablet edea94f15dda4ba382539dd0b44b2c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:27 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:42212
I20260810 01:42:27.708914 28199 tablet_service.cc:1514] Processing DeleteTablet for tablet edea94f15dda4ba382539dd0b44b2c69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:27 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:60782
I20260810 01:42:27.709275 28807 tablet_replica.cc:330] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: stopping tablet replica
I20260810 01:42:27.709559 28807 raft_consensus.cc:2229] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:27.709583 28808 tablet_replica.cc:330] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: stopping tablet replica
I20260810 01:42:27.709841 28807 raft_consensus.cc:2258] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:27.709846 28808 raft_consensus.cc:2229] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:27.710188 28806 tablet_replica.cc:330] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: stopping tablet replica
I20260810 01:42:27.710215 27967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 01:42:27.710444 28806 raft_consensus.cc:2229] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 01:42:27.710610 27967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:27.710678 28806 raft_consensus.cc:2258] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:27.711505 28808 raft_consensus.cc:2258] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:27.712658 28807 ts_tablet_manager.cc:1905] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:27.714006 28808 ts_tablet_manager.cc:1905] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:27.715312 28807 ts_tablet_manager.cc:1918] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:27.715406 28807 log.cc:1196] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/edea94f15dda4ba382539dd0b44b2c69
I20260810 01:42:27.715565 28404 tablet_service.cc:1467] Processing CreateTablet for tablet 046593f93ba64ed19347f425000c6783 (DEFAULT_TABLE table=test-table [id=211cb0b816e14cd3adbbbef674f3d567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:27.715648 28199 tablet_service.cc:1467] Processing CreateTablet for tablet 046593f93ba64ed19347f425000c6783 (DEFAULT_TABLE table=test-table [id=211cb0b816e14cd3adbbbef674f3d567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:27.715704 28807 ts_tablet_manager.cc:1939] T edea94f15dda4ba382539dd0b44b2c69 P bb4784b7100949219f6bae958ffa6cd9: Deleting consensus metadata
I20260810 01:42:27.715876 28404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 046593f93ba64ed19347f425000c6783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:27.715909 28199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 046593f93ba64ed19347f425000c6783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:27.718408 28766 tablet_bootstrap.cc:492] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Bootstrap starting.
I20260810 01:42:27.719306 28766 tablet_bootstrap.cc:654] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:27.719898 28765 tablet_bootstrap.cc:492] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: Bootstrap starting.
I20260810 01:42:27.720379 28766 tablet_bootstrap.cc:492] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: No bootstrap required, opened a new log
I20260810 01:42:27.720458 28766 ts_tablet_manager.cc:1397] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:42:27.720775 28765 tablet_bootstrap.cc:654] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:27.720831 28766 raft_consensus.cc:348] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:27.720930 28766 raft_consensus.cc:374] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:27.720981 28766 raft_consensus.cc:729] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d9c4563a0c406ab9d3ac7b2ebcdb62, State: Initialized, Role: FOLLOWER
I20260810 01:42:27.721093 28766 consensus_queue.cc:260] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:27.721336 28766 ts_tablet_manager.cc:1428] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:27.722030 27939 catalog_manager.cc:4841] TS bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821): tablet edea94f15dda4ba382539dd0b44b2c69 (table test-table [id=4ca2170f560143879eba6d49924ab8d3]) successfully deleted
I20260810 01:42:27.722304 28625 tablet_service.cc:1467] Processing CreateTablet for tablet 046593f93ba64ed19347f425000c6783 (DEFAULT_TABLE table=test-table [id=211cb0b816e14cd3adbbbef674f3d567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:27.722532 28625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 046593f93ba64ed19347f425000c6783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:27.724247 28765 tablet_bootstrap.cc:492] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: No bootstrap required, opened a new log
I20260810 01:42:27.724326 28765 ts_tablet_manager.cc:1397] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 01:42:27.724545 28775 tablet_bootstrap.cc:492] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: Bootstrap starting.
I20260810 01:42:27.724754 28765 raft_consensus.cc:348] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:27.724851 28765 raft_consensus.cc:374] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:27.724881 28765 raft_consensus.cc:729] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29bb55af476e4a4ebd867d6085de7824, State: Initialized, Role: FOLLOWER
I20260810 01:42:27.725003 28765 consensus_queue.cc:260] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:27.725273 28765 ts_tablet_manager.cc:1428] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:27.725446 28775 tablet_bootstrap.cc:654] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:27.727355 28808 ts_tablet_manager.cc:1918] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:27.727440 28808 log.cc:1196] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/edea94f15dda4ba382539dd0b44b2c69
I20260810 01:42:27.727749 28808 ts_tablet_manager.cc:1939] T edea94f15dda4ba382539dd0b44b2c69 P 29bb55af476e4a4ebd867d6085de7824: Deleting consensus metadata
I20260810 01:42:27.728322 28775 tablet_bootstrap.cc:492] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: No bootstrap required, opened a new log
I20260810 01:42:27.728403 28775 ts_tablet_manager.cc:1397] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260810 01:42:27.728819 28775 raft_consensus.cc:348] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:27.728914 28775 raft_consensus.cc:374] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:27.728888 27945 catalog_manager.cc:4841] TS 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65:45569): tablet edea94f15dda4ba382539dd0b44b2c69 (table test-table [id=4ca2170f560143879eba6d49924ab8d3]) successfully deleted
I20260810 01:42:27.728945 28775 raft_consensus.cc:729] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4784b7100949219f6bae958ffa6cd9, State: Initialized, Role: FOLLOWER
I20260810 01:42:27.729053 28775 consensus_queue.cc:260] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:27.729305 28775 ts_tablet_manager.cc:1428] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:27.729583 28806 ts_tablet_manager.cc:1905] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:27.731956 28806 ts_tablet_manager.cc:1918] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:27.732041 28806 log.cc:1196] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/edea94f15dda4ba382539dd0b44b2c69
I20260810 01:42:27.732328 28806 ts_tablet_manager.cc:1939] T edea94f15dda4ba382539dd0b44b2c69 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting consensus metadata
I20260810 01:42:27.733261 27942 catalog_manager.cc:4841] TS 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239): tablet edea94f15dda4ba382539dd0b44b2c69 (table test-table [id=4ca2170f560143879eba6d49924ab8d3]) successfully deleted
W20260810 01:42:27.737421 28505 tablet.cc:2369] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:27.901687 28802 raft_consensus.cc:482] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:27.901820 28802 raft_consensus.cc:504] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:27.902230 28802 leader_election.cc:288] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239), bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821)
I20260810 01:42:27.902686 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046593f93ba64ed19347f425000c6783" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" is_pre_election: true
I20260810 01:42:27.902856 28431 raft_consensus.cc:2454] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 0.
I20260810 01:42:27.902838 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046593f93ba64ed19347f425000c6783" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9" is_pre_election: true
I20260810 01:42:27.902968 28656 raft_consensus.cc:2454] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 0.
I20260810 01:42:27.903210 28114 leader_election.cc:302] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d9c4563a0c406ab9d3ac7b2ebcdb62, 29bb55af476e4a4ebd867d6085de7824; no voters:
I20260810 01:42:27.903386 28802 raft_consensus.cc:2781] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:27.903460 28802 raft_consensus.cc:482] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:27.903486 28802 raft_consensus.cc:3037] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:27.904501 28802 raft_consensus.cc:504] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:27.904793 28802 leader_election.cc:288] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 election: Requested vote from peers 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239), bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821)
I20260810 01:42:27.905114 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046593f93ba64ed19347f425000c6783" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62"
I20260810 01:42:27.905177 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "046593f93ba64ed19347f425000c6783" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9"
I20260810 01:42:27.905256 28431 raft_consensus.cc:3037] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:27.905275 28656 raft_consensus.cc:3037] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:27.906322 28431 raft_consensus.cc:2454] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 1.
I20260810 01:42:27.906322 28656 raft_consensus.cc:2454] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 1.
I20260810 01:42:27.906590 28111 leader_election.cc:302] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29bb55af476e4a4ebd867d6085de7824, bb4784b7100949219f6bae958ffa6cd9; no voters:
I20260810 01:42:27.906754 28802 raft_consensus.cc:2781] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:27.906844 28802 raft_consensus.cc:686] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 1 LEADER]: Becoming Leader. State: Replica: 29bb55af476e4a4ebd867d6085de7824, State: Running, Role: LEADER
I20260810 01:42:27.906970 28802 consensus_queue.cc:237] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:27.908645 27967 catalog_manager.cc:5495] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65). New cstate: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } health_report { overall_health: UNKNOWN } } }
Aug 10 01:42:27 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326146, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.126@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:27.988858 28824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.981267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:36845 (local address 127.0.0.1:53468)
0810 01:42:27.981558 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:27.981572 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:27.981683 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:27.981904 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:27.981907 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:27.982316 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:27.982405 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.982411 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.983126 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.983129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.983677 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:27.983684 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.984125 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.984129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:27.984204 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.984715 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:27.984728 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:27.986087 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:27.987454 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.987463 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.987468 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.987692 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.987962 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:27.987965 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:27.987967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:27.988072 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:27.988391 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:27.988396 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:27.988497 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 01:42:27.988581 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 01:42:27.988708 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":101,"threads_started":1}
I20260810 01:42:27.988894 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:27.981329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53468 (local address 127.16.58.126:36845)
0810 01:42:27.981538 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:27.981547 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:27.981631 (+ 84us) server_negotiation.cc:407] Connection header received
0810 01:42:27.981772 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:27.981775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:27.981809 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:27.981877 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:27.982511 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.983032 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.983776 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:27.984025 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:27.984105 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:27.986212 (+ 2107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:27.986215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:27.986217 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:27.986239 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:27.987358 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.987761 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.987764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.987765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.987874 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:27.988146 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:27.988148 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:27.988149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:27.988315 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:27.988387 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:27.988627 (+ 240us) server_negotiation.cc:299] Negotiation successful
0810 01:42:27.988764 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":138,"thread_start_us":72,"threads_started":1}
I20260810 01:42:27.992368 27967 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:53468:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 01:42:27.993029 27967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:27.997579 28199 tablet_service.cc:1467] Processing CreateTablet for tablet 999438d7e72444138c05c1b6c488b8dc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=92f99678c87f48068af9c78f786227a9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:42:27.997653 28404 tablet_service.cc:1467] Processing CreateTablet for tablet 999438d7e72444138c05c1b6c488b8dc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=92f99678c87f48068af9c78f786227a9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:42:27.997985 28199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999438d7e72444138c05c1b6c488b8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:27.998055 28404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999438d7e72444138c05c1b6c488b8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:28.000633 28625 tablet_service.cc:1467] Processing CreateTablet for tablet 999438d7e72444138c05c1b6c488b8dc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=92f99678c87f48068af9c78f786227a9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 01:42:28.001024 28625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999438d7e72444138c05c1b6c488b8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:28.001592 28766 tablet_bootstrap.cc:492] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Bootstrap starting.
I20260810 01:42:28.002535 28766 tablet_bootstrap.cc:654] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:28.003724 28775 tablet_bootstrap.cc:492] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: Bootstrap starting.
I20260810 01:42:28.003852 28765 tablet_bootstrap.cc:492] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: Bootstrap starting.
I20260810 01:42:28.004554 28765 tablet_bootstrap.cc:654] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:28.004554 28766 tablet_bootstrap.cc:492] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: No bootstrap required, opened a new log
I20260810 01:42:28.004633 28766 ts_tablet_manager.cc:1397] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:42:28.004657 28775 tablet_bootstrap.cc:654] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:28.005076 28766 raft_consensus.cc:348] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.005206 28766 raft_consensus.cc:374] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:28.005239 28766 raft_consensus.cc:729] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d9c4563a0c406ab9d3ac7b2ebcdb62, State: Initialized, Role: FOLLOWER
I20260810 01:42:28.005368 28766 consensus_queue.cc:260] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.005545 28765 tablet_bootstrap.cc:492] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: No bootstrap required, opened a new log
I20260810 01:42:28.005643 28765 ts_tablet_manager.cc:1397] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:28.005613 28779 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.005746 28779 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:28.005746 28775 tablet_bootstrap.cc:492] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: No bootstrap required, opened a new log
I20260810 01:42:28.005820 28775 ts_tablet_manager.cc:1397] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:28.006027 28765 raft_consensus.cc:348] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.006140 28765 raft_consensus.cc:374] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:28.006181 28765 raft_consensus.cc:729] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29bb55af476e4a4ebd867d6085de7824, State: Initialized, Role: FOLLOWER
I20260810 01:42:28.006181 28775 raft_consensus.cc:348] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.006290 28775 raft_consensus.cc:374] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:28.006327 28775 raft_consensus.cc:729] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4784b7100949219f6bae958ffa6cd9, State: Initialized, Role: FOLLOWER
I20260810 01:42:28.006295 28765 consensus_queue.cc:260] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.006446 28775 consensus_queue.cc:260] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.006569 28765 ts_tablet_manager.cc:1428] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:28.006551 28785 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.006722 28775 ts_tablet_manager.cc:1428] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:28.006747 28785 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:28.006789 28780 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.006924 28780 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:28.007418 28766 ts_tablet_manager.cc:1428] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260810 01:42:28.022294 28785 raft_consensus.cc:482] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:28.022387 28785 raft_consensus.cc:504] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.022719 28785 leader_election.cc:288] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239), bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821)
I20260810 01:42:28.023058 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999438d7e72444138c05c1b6c488b8dc" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9" is_pre_election: true
I20260810 01:42:28.023047 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999438d7e72444138c05c1b6c488b8dc" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" is_pre_election: true
I20260810 01:42:28.023180 28431 raft_consensus.cc:2454] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 0.
I20260810 01:42:28.023180 28656 raft_consensus.cc:2454] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 0.
I20260810 01:42:28.023422 28114 leader_election.cc:302] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d9c4563a0c406ab9d3ac7b2ebcdb62, 29bb55af476e4a4ebd867d6085de7824; no voters:
I20260810 01:42:28.023615 28785 raft_consensus.cc:2781] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:28.023671 28785 raft_consensus.cc:482] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:28.023698 28785 raft_consensus.cc:3037] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:28.024577 28785 raft_consensus.cc:504] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.024899 28785 leader_election.cc:288] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 election: Requested vote from peers 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239), bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821)
I20260810 01:42:28.025177 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999438d7e72444138c05c1b6c488b8dc" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9"
I20260810 01:42:28.025207 28431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999438d7e72444138c05c1b6c488b8dc" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62"
I20260810 01:42:28.025277 28656 raft_consensus.cc:3037] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:28.025311 28431 raft_consensus.cc:3037] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:28.026032 28656 raft_consensus.cc:2454] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 1.
I20260810 01:42:28.026285 28111 leader_election.cc:302] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29bb55af476e4a4ebd867d6085de7824, bb4784b7100949219f6bae958ffa6cd9; no voters:
I20260810 01:42:28.026331 28431 raft_consensus.cc:2454] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 1.
I20260810 01:42:28.026456 28785 raft_consensus.cc:2781] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:28.026546 28785 raft_consensus.cc:686] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [term 1 LEADER]: Becoming Leader. State: Replica: 29bb55af476e4a4ebd867d6085de7824, State: Running, Role: LEADER
I20260810 01:42:28.026683 28785 consensus_queue.cc:237] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.027356 28785 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: TxnStatusTablet state changed. Reason: New leader 29bb55af476e4a4ebd867d6085de7824. Latest consensus state: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.027449 28785 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:42:28.027853 28832 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 01:42:28.028013 28832 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 01:42:28.028317 27965 catalog_manager.cc:5495] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65). New cstate: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } health_report { overall_health: UNKNOWN } } }
I20260810 01:42:28.044819 28824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.041598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:45569 (local address 127.0.0.1:60812)
0810 01:42:28.041729 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:28.041745 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:28.041832 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:28.042066 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:28.042068 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:28.042074 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:42:28.042173 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.042178 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.043105 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.043107 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.043702 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.043708 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.044243 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.044245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.044306 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.044349 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.044601 (+ 252us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.044608 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 01:42:28.044651 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 01:42:28.044719 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 01:42:28.044831 28762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.041682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60812 (local address 127.16.58.65:45569)
0810 01:42:28.041796 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.041800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.041814 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:42:28.041927 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.041930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.041976 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.042045 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:28.042250 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.043020 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.043790 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.044156 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.044253 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.044454 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.044528 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.044590 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:28.044663 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 01:42:28.044712 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:42:28.046967 28656 raft_consensus.cc:1261] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Refusing update from remote peer 29bb55af476e4a4ebd867d6085de7824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:28.046977 28431 raft_consensus.cc:1261] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Refusing update from remote peer 29bb55af476e4a4ebd867d6085de7824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:28.047382 28802 consensus_queue.cc:1035] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:28.047519 28785 consensus_queue.cc:1035] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:28.048859 28779 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: TxnStatusTablet state changed. Reason: New leader 29bb55af476e4a4ebd867d6085de7824. Latest consensus state: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.048961 28779 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:28.049208 28780 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: TxnStatusTablet state changed. Reason: New leader 29bb55af476e4a4ebd867d6085de7824. Latest consensus state: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.049304 28780 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:28.050694 28777 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.050792 28777 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:42:28.051466 28780 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.051584 28780 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P bb4784b7100949219f6bae958ffa6cd9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:28.052356 28802 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.052451 28802 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P 29bb55af476e4a4ebd867d6085de7824: This TxnStatusTablet replica's current role is: LEADER
I20260810 01:42:28.054636 28779 tablet_replica.cc:439] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } } }
I20260810 01:42:28.054733 28779 tablet_replica.cc:442] T 999438d7e72444138c05c1b6c488b8dc P 13d9c4563a0c406ab9d3ac7b2ebcdb62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 01:42:28.065547 28843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.061913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:45569 (local address 127.16.58.65:37099)
0810 01:42:28.062178 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:28.062192 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:28.062274 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:28.062462 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:28.062463 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:28.062469 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:42:28.062575 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.062579 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.063534 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.063537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.064159 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.064168 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.064735 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.064740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.064848 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.064904 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.065226 (+ 322us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.065234 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 01:42:28.065315 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 01:42:28.065398 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":17,"thread_start_us":86,"threads_started":1}
I20260810 01:42:28.065575 28762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.061984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:37099 (local address 127.16.58.65:45569)
0810 01:42:28.062083 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.062087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.062256 (+ 169us) server_negotiation.cc:407] Connection header received
0810 01:42:28.062340 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.062343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.062386 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.062458 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:28.062651 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.063376 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.064269 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.064602 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.064702 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.065078 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.065152 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.065218 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:28.065354 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 01:42:28.065401 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":38}
I20260810 01:42:28.072651 28656 raft_consensus.cc:1261] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Refusing update from remote peer 29bb55af476e4a4ebd867d6085de7824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:28.072760 28431 raft_consensus.cc:1261] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Refusing update from remote peer 29bb55af476e4a4ebd867d6085de7824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:28.073057 28785 consensus_queue.cc:1035] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:28.073199 28777 consensus_queue.cc:1035] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:28.106374 27967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:28.106518 27967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:28.108287 27967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: Sending DeleteTablet for 3 replicas of tablet 046593f93ba64ed19347f425000c6783
I20260810 01:42:28.108738 28199 tablet_service.cc:1514] Processing DeleteTablet for tablet 046593f93ba64ed19347f425000c6783 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:28 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:60782
I20260810 01:42:28.108901 28808 tablet_replica.cc:330] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: stopping tablet replica
I20260810 01:42:28.108906 28404 tablet_service.cc:1514] Processing DeleteTablet for tablet 046593f93ba64ed19347f425000c6783 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:28 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:40580
I20260810 01:42:28.109015 28808 raft_consensus.cc:2229] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:28.109048 28806 tablet_replica.cc:330] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: stopping tablet replica
I20260810 01:42:28.109130 28806 raft_consensus.cc:2229] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:28.109184 28625 tablet_service.cc:1514] Processing DeleteTablet for tablet 046593f93ba64ed19347f425000c6783 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:28 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:42212
I20260810 01:42:28.109213 28806 raft_consensus.cc:2258] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:28.109206 28808 raft_consensus.cc:2258] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:28.109345 28807 tablet_replica.cc:330] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: stopping tablet replica
I20260810 01:42:28.109443 28807 raft_consensus.cc:2229] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:28.109532 28807 raft_consensus.cc:2258] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:28.109902 28808 ts_tablet_manager.cc:1905] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:28.110096 28807 ts_tablet_manager.cc:1905] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:28.112751 28807 ts_tablet_manager.cc:1918] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:28.112763 28808 ts_tablet_manager.cc:1918] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:28.112826 28807 log.cc:1196] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/046593f93ba64ed19347f425000c6783
I20260810 01:42:28.112838 28808 log.cc:1196] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/046593f93ba64ed19347f425000c6783
I20260810 01:42:28.113073 28807 ts_tablet_manager.cc:1939] T 046593f93ba64ed19347f425000c6783 P bb4784b7100949219f6bae958ffa6cd9: Deleting consensus metadata
I20260810 01:42:28.113094 28808 ts_tablet_manager.cc:1939] T 046593f93ba64ed19347f425000c6783 P 29bb55af476e4a4ebd867d6085de7824: Deleting consensus metadata
I20260810 01:42:28.113745 27939 catalog_manager.cc:4841] TS bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821): tablet 046593f93ba64ed19347f425000c6783 (table test-table [id=211cb0b816e14cd3adbbbef674f3d567]) successfully deleted
I20260810 01:42:28.114264 27945 catalog_manager.cc:4841] TS 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65:45569): tablet 046593f93ba64ed19347f425000c6783 (table test-table [id=211cb0b816e14cd3adbbbef674f3d567]) successfully deleted
I20260810 01:42:28.114692 28806 ts_tablet_manager.cc:1905] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:28.116721 28806 ts_tablet_manager.cc:1918] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:28.116788 28806 log.cc:1196] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/046593f93ba64ed19347f425000c6783
I20260810 01:42:28.116974 28806 ts_tablet_manager.cc:1939] T 046593f93ba64ed19347f425000c6783 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting consensus metadata
I20260810 01:42:28.117530 27942 catalog_manager.cc:4841] TS 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239): tablet 046593f93ba64ed19347f425000c6783 (table test-table [id=211cb0b816e14cd3adbbbef674f3d567]) successfully deleted
Aug 10 01:42:28 dist-test-slave-jlzn krb5kdc[27896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 01:42:28 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:28 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 01:42:28.140301 28826 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:28.133584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53472 (local address 127.16.58.126:36845)
0810 01:42:28.133729 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.133734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.133987 (+ 253us) server_negotiation.cc:407] Connection header received
0810 01:42:28.134117 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.134120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.134170 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.134235 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:28.135063 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.135612 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.136804 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.137029 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.137101 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.140176 (+ 3075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53472: BlockingRecv error: recv got EOF from 127.0.0.1:53472 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 01:42:28 dist-test-slave-jlzn krb5kdc[27896](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM
I20260810 01:42:28.150389 28826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.142094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53482 (local address 127.16.58.126:36845)
0810 01:42:28.142213 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.142216 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.142509 (+ 293us) server_negotiation.cc:407] Connection header received
0810 01:42:28.142581 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.142585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.142642 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.142727 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:28.143216 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.143988 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.144728 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.145053 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.145159 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.147243 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:28.147247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:28.147250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:28.147277 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:28.148886 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:28.149282 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:28.149285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:28.149287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:28.149385 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:28.149607 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:28.149610 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:28.149612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:28.149840 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:28.149980 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:28.150117 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 01:42:28.150240 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:42:28.152872 27967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:28.153344 27967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:28.158088 28199 tablet_service.cc:1467] Processing CreateTablet for tablet a29141b01ca74141a93e815acdc04680 (DEFAULT_TABLE table=test-table [id=e43a483f577445f5848942a762385509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:28.158419 28199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a29141b01ca74141a93e815acdc04680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:28.158383 28625 tablet_service.cc:1467] Processing CreateTablet for tablet a29141b01ca74141a93e815acdc04680 (DEFAULT_TABLE table=test-table [id=e43a483f577445f5848942a762385509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:28.158413 28404 tablet_service.cc:1467] Processing CreateTablet for tablet a29141b01ca74141a93e815acdc04680 (DEFAULT_TABLE table=test-table [id=e43a483f577445f5848942a762385509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:28.158648 28625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a29141b01ca74141a93e815acdc04680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:28.158686 28404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a29141b01ca74141a93e815acdc04680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:28.160934 28775 tablet_bootstrap.cc:492] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: Bootstrap starting.
I20260810 01:42:28.160960 28765 tablet_bootstrap.cc:492] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: Bootstrap starting.
I20260810 01:42:28.161696 28765 tablet_bootstrap.cc:654] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:28.161835 28775 tablet_bootstrap.cc:654] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:28.162146 28766 tablet_bootstrap.cc:492] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Bootstrap starting.
I20260810 01:42:28.162890 28766 tablet_bootstrap.cc:654] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:28.163966 28766 tablet_bootstrap.cc:492] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: No bootstrap required, opened a new log
I20260810 01:42:28.164050 28766 ts_tablet_manager.cc:1397] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260810 01:42:28.164254 28765 tablet_bootstrap.cc:492] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: No bootstrap required, opened a new log
I20260810 01:42:28.164337 28765 ts_tablet_manager.cc:1397] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 01:42:28.164454 28766 raft_consensus.cc:348] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.164567 28766 raft_consensus.cc:374] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:28.164595 28766 raft_consensus.cc:729] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d9c4563a0c406ab9d3ac7b2ebcdb62, State: Initialized, Role: FOLLOWER
I20260810 01:42:28.164729 28766 consensus_queue.cc:260] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.164729 28765 raft_consensus.cc:348] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.164829 28765 raft_consensus.cc:374] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:28.164851 28765 raft_consensus.cc:729] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29bb55af476e4a4ebd867d6085de7824, State: Initialized, Role: FOLLOWER
I20260810 01:42:28.164965 28765 consensus_queue.cc:260] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.165009 28766 ts_tablet_manager.cc:1428] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:28.165218 28765 ts_tablet_manager.cc:1428] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:28.166735 28775 tablet_bootstrap.cc:492] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: No bootstrap required, opened a new log
I20260810 01:42:28.166823 28775 ts_tablet_manager.cc:1397] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260810 01:42:28.167265 28775 raft_consensus.cc:348] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.167376 28775 raft_consensus.cc:374] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:28.167407 28775 raft_consensus.cc:729] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4784b7100949219f6bae958ffa6cd9, State: Initialized, Role: FOLLOWER
I20260810 01:42:28.167547 28775 consensus_queue.cc:260] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.167860 28775 ts_tablet_manager.cc:1428] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:28.191617 28785 raft_consensus.cc:482] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:28.191721 28785 raft_consensus.cc:504] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.192107 28785 leader_election.cc:288] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239), bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821)
I20260810 01:42:28.192484 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a29141b01ca74141a93e815acdc04680" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9" is_pre_election: true
I20260810 01:42:28.192473 28430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a29141b01ca74141a93e815acdc04680" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" is_pre_election: true
I20260810 01:42:28.192611 28656 raft_consensus.cc:2454] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 0.
I20260810 01:42:28.192611 28430 raft_consensus.cc:2454] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 0.
I20260810 01:42:28.192884 28111 leader_election.cc:302] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 13d9c4563a0c406ab9d3ac7b2ebcdb62, 29bb55af476e4a4ebd867d6085de7824, bb4784b7100949219f6bae958ffa6cd9; no voters:
I20260810 01:42:28.193058 28785 raft_consensus.cc:2781] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:28.193120 28785 raft_consensus.cc:482] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:28.193146 28785 raft_consensus.cc:3037] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:28.194027 28785 raft_consensus.cc:504] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.194317 28785 leader_election.cc:288] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 election: Requested vote from peers 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239), bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821)
I20260810 01:42:28.194664 28430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a29141b01ca74141a93e815acdc04680" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62"
I20260810 01:42:28.194664 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a29141b01ca74141a93e815acdc04680" candidate_uuid: "29bb55af476e4a4ebd867d6085de7824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9"
I20260810 01:42:28.194780 28430 raft_consensus.cc:3037] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:28.194780 28656 raft_consensus.cc:3037] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:28.195829 28430 raft_consensus.cc:2454] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 1.
I20260810 01:42:28.195830 28656 raft_consensus.cc:2454] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29bb55af476e4a4ebd867d6085de7824 in term 1.
I20260810 01:42:28.196112 28114 leader_election.cc:302] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d9c4563a0c406ab9d3ac7b2ebcdb62, 29bb55af476e4a4ebd867d6085de7824; no voters:
I20260810 01:42:28.196290 28785 raft_consensus.cc:2781] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:28.196372 28785 raft_consensus.cc:686] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 1 LEADER]: Becoming Leader. State: Replica: 29bb55af476e4a4ebd867d6085de7824, State: Running, Role: LEADER
I20260810 01:42:28.196485 28785 consensus_queue.cc:237] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.197870 27967 catalog_manager.cc:5495] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65). New cstate: current_term: 1 leader_uuid: "29bb55af476e4a4ebd867d6085de7824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } health_report { overall_health: UNKNOWN } } }
I20260810 01:42:28.208989 28762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.206421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60828 (local address 127.16.58.65:45569)
0810 01:42:28.206535 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.206538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.206552 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:42:28.206664 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.206666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.206705 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.206762 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:28.206938 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.207418 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.208216 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.208416 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.208488 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.208665 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.208723 (+ 58us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.208775 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:28.208829 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 01:42:28.208870 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:42:28.210537 28430 raft_consensus.cc:1261] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Refusing update from remote peer 29bb55af476e4a4ebd867d6085de7824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:28.210538 28656 raft_consensus.cc:1261] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Refusing update from remote peer 29bb55af476e4a4ebd867d6085de7824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:28.210939 28777 consensus_queue.cc:1035] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:28.211086 28785 consensus_queue.cc:1035] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:28.217435 27963 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:28.217545 27963 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:28.219283 27963 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: Sending DeleteTablet for 3 replicas of tablet a29141b01ca74141a93e815acdc04680
I20260810 01:42:28.219730 28199 tablet_service.cc:1514] Processing DeleteTablet for tablet a29141b01ca74141a93e815acdc04680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:28 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:60782
I20260810 01:42:28.219776 28404 tablet_service.cc:1514] Processing DeleteTablet for tablet a29141b01ca74141a93e815acdc04680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:28 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:40580
I20260810 01:42:28.219913 28625 tablet_service.cc:1514] Processing DeleteTablet for tablet a29141b01ca74141a93e815acdc04680 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:28 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:42212
I20260810 01:42:28.219985 28808 tablet_replica.cc:330] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: stopping tablet replica
I20260810 01:42:28.220064 28807 tablet_replica.cc:330] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: stopping tablet replica
I20260810 01:42:28.220111 28808 raft_consensus.cc:2229] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:28.220189 28807 raft_consensus.cc:2229] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:28.220289 28808 raft_consensus.cc:2258] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:28.220310 28807 raft_consensus.cc:2258] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:28.220451 28806 tablet_replica.cc:330] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: stopping tablet replica
I20260810 01:42:28.220557 28806 raft_consensus.cc:2229] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:28.220666 28806 raft_consensus.cc:2258] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:28.220860 28808 ts_tablet_manager.cc:1905] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:28.220846 27963 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 01:42:28.221158 28807 ts_tablet_manager.cc:1905] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 01:42:28.221221 27963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:28.221278 28806 ts_tablet_manager.cc:1905] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:28.222872 28808 ts_tablet_manager.cc:1918] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:28.222925 28808 log.cc:1196] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/a29141b01ca74141a93e815acdc04680
I20260810 01:42:28.223088 28808 ts_tablet_manager.cc:1939] T a29141b01ca74141a93e815acdc04680 P 29bb55af476e4a4ebd867d6085de7824: Deleting consensus metadata
I20260810 01:42:28.223456 28807 ts_tablet_manager.cc:1918] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:28.223456 28806 ts_tablet_manager.cc:1918] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:28.223522 28807 log.cc:1196] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/a29141b01ca74141a93e815acdc04680
I20260810 01:42:28.223522 28806 log.cc:1196] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/a29141b01ca74141a93e815acdc04680
I20260810 01:42:28.223757 28806 ts_tablet_manager.cc:1939] T a29141b01ca74141a93e815acdc04680 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting consensus metadata
I20260810 01:42:28.223757 28807 ts_tablet_manager.cc:1939] T a29141b01ca74141a93e815acdc04680 P bb4784b7100949219f6bae958ffa6cd9: Deleting consensus metadata
I20260810 01:42:28.224409 27942 catalog_manager.cc:4841] TS 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239): tablet a29141b01ca74141a93e815acdc04680 (table test-table [id=e43a483f577445f5848942a762385509]) successfully deleted
I20260810 01:42:28.224409 27945 catalog_manager.cc:4841] TS 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65:45569): tablet a29141b01ca74141a93e815acdc04680 (table test-table [id=e43a483f577445f5848942a762385509]) successfully deleted
I20260810 01:42:28.224697 27939 catalog_manager.cc:4841] TS bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821): tablet a29141b01ca74141a93e815acdc04680 (table test-table [id=e43a483f577445f5848942a762385509]) successfully deleted
I20260810 01:42:28.227293 28199 tablet_service.cc:1467] Processing CreateTablet for tablet 2527045028f149b6b6ff7f19f04ea7b0 (DEFAULT_TABLE table=test-table [id=211a8f3f2e9944858f803072aab489d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:28.227376 28404 tablet_service.cc:1467] Processing CreateTablet for tablet 2527045028f149b6b6ff7f19f04ea7b0 (DEFAULT_TABLE table=test-table [id=211a8f3f2e9944858f803072aab489d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:28.227545 28199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2527045028f149b6b6ff7f19f04ea7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:28.227614 28404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2527045028f149b6b6ff7f19f04ea7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:28.227602 28625 tablet_service.cc:1467] Processing CreateTablet for tablet 2527045028f149b6b6ff7f19f04ea7b0 (DEFAULT_TABLE table=test-table [id=211a8f3f2e9944858f803072aab489d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:28.227842 28625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2527045028f149b6b6ff7f19f04ea7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:28.229228 28766 tablet_bootstrap.cc:492] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Bootstrap starting.
I20260810 01:42:28.229688 28765 tablet_bootstrap.cc:492] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: Bootstrap starting.
I20260810 01:42:28.229839 28775 tablet_bootstrap.cc:492] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: Bootstrap starting.
I20260810 01:42:28.230420 28766 tablet_bootstrap.cc:654] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:28.230453 28765 tablet_bootstrap.cc:654] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:28.231089 28775 tablet_bootstrap.cc:654] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:28.231467 28765 tablet_bootstrap.cc:492] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: No bootstrap required, opened a new log
I20260810 01:42:28.231556 28765 ts_tablet_manager.cc:1397] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:28.231945 28765 raft_consensus.cc:348] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.232033 28765 raft_consensus.cc:374] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:28.232053 28765 raft_consensus.cc:729] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29bb55af476e4a4ebd867d6085de7824, State: Initialized, Role: FOLLOWER
I20260810 01:42:28.232187 28775 tablet_bootstrap.cc:492] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: No bootstrap required, opened a new log
I20260810 01:42:28.232156 28765 consensus_queue.cc:260] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.232251 28775 ts_tablet_manager.cc:1397] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:28.232421 28765 ts_tablet_manager.cc:1428] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:28.232479 28766 tablet_bootstrap.cc:492] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: No bootstrap required, opened a new log
I20260810 01:42:28.232548 28766 ts_tablet_manager.cc:1397] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 01:42:28.232628 28775 raft_consensus.cc:348] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.232726 28775 raft_consensus.cc:374] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:28.232746 28775 raft_consensus.cc:729] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4784b7100949219f6bae958ffa6cd9, State: Initialized, Role: FOLLOWER
I20260810 01:42:28.232856 28775 consensus_queue.cc:260] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.232935 28766 raft_consensus.cc:348] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.233026 28766 raft_consensus.cc:374] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:28.233057 28766 raft_consensus.cc:729] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13d9c4563a0c406ab9d3ac7b2ebcdb62, State: Initialized, Role: FOLLOWER
I20260810 01:42:28.233096 28775 ts_tablet_manager.cc:1428] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 01:42:28.233168 28766 consensus_queue.cc:260] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.233414 28766 ts_tablet_manager.cc:1428] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:42:28.482261 28779 raft_consensus.cc:482] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:28.482403 28779 raft_consensus.cc:504] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.483487 28779 leader_election.cc:288] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65:45569), bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821)
I20260810 01:42:28.488479 28886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.483873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:39409 (local address 127.16.58.67:41821)
0810 01:42:28.484107 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.484112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.484129 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:42:28.484278 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.484281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.484331 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.484415 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:28.484805 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.485599 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.487241 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.487896 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.487991 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.488045 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:28.488277 (+ 232us) server_negotiation.cc:299] Negotiation successful
0810 01:42:28.488347 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
I20260810 01:42:28.488477 28762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.483822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:41789 (local address 127.16.58.65:45569)
0810 01:42:28.483948 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.483953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.484155 (+ 202us) server_negotiation.cc:407] Connection header received
0810 01:42:28.484279 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.484281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.484331 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.484415 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:28.484805 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.485599 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.487241 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.487867 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.487995 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.488045 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:28.488277 (+ 232us) server_negotiation.cc:299] Negotiation successful
0810 01:42:28.488347 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:28.488536 28884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.483772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:41821 (local address 127.16.58.66:39409)
0810 01:42:28.484049 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:28.484060 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:28.484180 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:28.484430 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:28.484433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:28.484475 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:28.484685 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.484693 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.485713 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.485717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.487121 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.487134 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.487986 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.487990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.488122 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.488179 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 01:42:28.488257 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:42:28.488352 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":117,"spinlock_wait_cycles":5120,"thread_start_us":75,"threads_started":1}
I20260810 01:42:28.488536 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.483695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:45569 (local address 127.16.58.66:41789)
0810 01:42:28.484041 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:28.484055 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:28.484172 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:28.484430 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:28.484433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:28.484473 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:28.484693 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.484700 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.485713 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.485717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.487128 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.487135 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.487986 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.487990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.488162 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.488180 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 01:42:28.488257 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:42:28.488352 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":225,"spinlock_wait_cycles":31360,"thread_start_us":116,"threads_started":1}
I20260810 01:42:28.489255 28232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2527045028f149b6b6ff7f19f04ea7b0" candidate_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29bb55af476e4a4ebd867d6085de7824" is_pre_election: true
I20260810 01:42:28.489398 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2527045028f149b6b6ff7f19f04ea7b0" candidate_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9" is_pre_election: true
I20260810 01:42:28.489468 28232 raft_consensus.cc:2454] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d9c4563a0c406ab9d3ac7b2ebcdb62 in term 0.
I20260810 01:42:28.489549 28656 raft_consensus.cc:2454] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13d9c4563a0c406ab9d3ac7b2ebcdb62 in term 0.
I20260810 01:42:28.489885 28337 leader_election.cc:302] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 13d9c4563a0c406ab9d3ac7b2ebcdb62, 29bb55af476e4a4ebd867d6085de7824, bb4784b7100949219f6bae958ffa6cd9; no voters:
I20260810 01:42:28.490197 28779 raft_consensus.cc:2781] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:28.490262 28779 raft_consensus.cc:482] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:28.490298 28779 raft_consensus.cc:3037] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:28.491447 28779 raft_consensus.cc:504] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.491839 28779 leader_election.cc:288] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [CANDIDATE]: Term 1 election: Requested vote from peers 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65:45569), bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821)
I20260810 01:42:28.492290 28656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2527045028f149b6b6ff7f19f04ea7b0" candidate_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb4784b7100949219f6bae958ffa6cd9"
I20260810 01:42:28.492353 28232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2527045028f149b6b6ff7f19f04ea7b0" candidate_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29bb55af476e4a4ebd867d6085de7824"
I20260810 01:42:28.492405 28656 raft_consensus.cc:3037] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:28.492477 28232 raft_consensus.cc:3037] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:28.493465 28656 raft_consensus.cc:2454] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d9c4563a0c406ab9d3ac7b2ebcdb62 in term 1.
I20260810 01:42:28.493662 28232 raft_consensus.cc:2454] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13d9c4563a0c406ab9d3ac7b2ebcdb62 in term 1.
I20260810 01:42:28.493721 28333 leader_election.cc:302] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13d9c4563a0c406ab9d3ac7b2ebcdb62, bb4784b7100949219f6bae958ffa6cd9; no voters:
I20260810 01:42:28.493871 28779 raft_consensus.cc:2781] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:28.494069 28779 raft_consensus.cc:686] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 LEADER]: Becoming Leader. State: Replica: 13d9c4563a0c406ab9d3ac7b2ebcdb62, State: Running, Role: LEADER
I20260810 01:42:28.494309 28779 consensus_queue.cc:237] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } }
I20260810 01:42:28.496547 27963 catalog_manager.cc:5495] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13d9c4563a0c406ab9d3ac7b2ebcdb62" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 } health_report { overall_health: UNKNOWN } } }
I20260810 01:42:28.528576 28889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.525207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40592 (local address 127.16.58.66:34239)
0810 01:42:28.525426 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.525430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.525442 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:28.525506 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.525508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.525554 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.525658 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:28.525883 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.526386 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.527192 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.527411 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.527492 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.527761 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.528191 (+ 430us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.528292 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:28.528376 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 01:42:28.528427 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":74,"threads_started":1}
I20260810 01:42:28.537065 28762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.534479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:38623 (local address 127.16.58.65:45569)
0810 01:42:28.534580 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.534583 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.534745 (+ 162us) server_negotiation.cc:407] Connection header received
0810 01:42:28.534848 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.534850 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.534887 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.534938 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:28.535100 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.535552 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.536321 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.536522 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.536591 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.536788 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.536843 (+ 55us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.536888 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:28.536943 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 01:42:28.536979 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:42:28.537101 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.534413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:45569 (local address 127.16.58.66:38623)
0810 01:42:28.534681 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:28.534693 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:28.534771 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:28.534947 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:28.534949 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:28.534954 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:42:28.535036 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.535040 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.535623 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.535626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.536237 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.536245 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.536596 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.536598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.536662 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.536701 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.536894 (+ 193us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.536898 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:42:28.536936 (+ 38us) client_negotiation.cc:240] Negotiation successful
0810 01:42:28.536990 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":90,"threads_started":1}
I20260810 01:42:28.542007 28656 raft_consensus.cc:1261] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Refusing update from remote peer 13d9c4563a0c406ab9d3ac7b2ebcdb62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:28.542181 28232 raft_consensus.cc:1261] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Refusing update from remote peer 13d9c4563a0c406ab9d3ac7b2ebcdb62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:28.542655 28887 consensus_queue.cc:1035] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29bb55af476e4a4ebd867d6085de7824" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 45569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:28.543172 28887 consensus_queue.cc:1035] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb4784b7100949219f6bae958ffa6cd9" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:28.558830 28889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.556069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:50919 (local address 127.16.58.66:34239)
0810 01:42:28.556154 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:28.556158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:28.556195 (+ 37us) server_negotiation.cc:407] Connection header received
0810 01:42:28.556304 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:28.556308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:28.556352 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:28.556423 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:28.556618 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.557117 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.557870 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.558103 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.558190 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.558471 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.558548 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.558618 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:28.558688 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 01:42:28.558740 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 01:42:28.558869 28843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:28.555982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34239 (local address 127.16.58.65:50919)
0810 01:42:28.556146 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:28.556160 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:28.556237 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:28.556429 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:28.556432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:28.556439 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 01:42:28.556528 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.556534 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.557192 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.557195 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.557782 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:28.557791 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:28.558266 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:28.558269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:28.558336 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:28.558359 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 01:42:28.558622 (+ 263us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 01:42:28.558627 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:42:28.558675 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 01:42:28.558757 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 01:42:28.575886 27967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:28.576018 27967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:28.577811 27967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a0fd5959956a41df80b57b212be21dd6: Sending DeleteTablet for 3 replicas of tablet 2527045028f149b6b6ff7f19f04ea7b0
I20260810 01:42:28.578280 28199 tablet_service.cc:1514] Processing DeleteTablet for tablet 2527045028f149b6b6ff7f19f04ea7b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:28 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:60782
I20260810 01:42:28.578306 28404 tablet_service.cc:1514] Processing DeleteTablet for tablet 2527045028f149b6b6ff7f19f04ea7b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:28 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:40580
I20260810 01:42:28.578466 28806 tablet_replica.cc:330] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: stopping tablet replica
I20260810 01:42:28.578477 28808 tablet_replica.cc:330] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: stopping tablet replica
I20260810 01:42:28.578576 28808 raft_consensus.cc:2229] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:28.578579 28806 raft_consensus.cc:2229] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:28.578680 28808 raft_consensus.cc:2258] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:28.578840 28806 raft_consensus.cc:2258] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:28.578866 28625 tablet_service.cc:1514] Processing DeleteTablet for tablet 2527045028f149b6b6ff7f19f04ea7b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:28 UTC) from {username='oryx', principal='oryx/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:42212
I20260810 01:42:28.579017 28807 tablet_replica.cc:330] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: stopping tablet replica
I20260810 01:42:28.579124 28807 raft_consensus.cc:2229] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:28.579242 28807 raft_consensus.cc:2258] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:28.579545 28806 ts_tablet_manager.cc:1905] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:28.580317 28808 ts_tablet_manager.cc:1905] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:28.582036 28806 ts_tablet_manager.cc:1918] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:28.582116 28806 log.cc:1196] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/2527045028f149b6b6ff7f19f04ea7b0
I20260810 01:42:28.582365 28806 ts_tablet_manager.cc:1939] T 2527045028f149b6b6ff7f19f04ea7b0 P 13d9c4563a0c406ab9d3ac7b2ebcdb62: Deleting consensus metadata
I20260810 01:42:28.582680 28808 ts_tablet_manager.cc:1918] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:28.582758 28808 log.cc:1196] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/2527045028f149b6b6ff7f19f04ea7b0
I20260810 01:42:28.582990 28808 ts_tablet_manager.cc:1939] T 2527045028f149b6b6ff7f19f04ea7b0 P 29bb55af476e4a4ebd867d6085de7824: Deleting consensus metadata
I20260810 01:42:28.582995 27942 catalog_manager.cc:4841] TS 13d9c4563a0c406ab9d3ac7b2ebcdb62 (127.16.58.66:34239): tablet 2527045028f149b6b6ff7f19f04ea7b0 (table test-table [id=211a8f3f2e9944858f803072aab489d8]) successfully deleted
I20260810 01:42:28.583570 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 28081
I20260810 01:42:28.583593 27945 catalog_manager.cc:4841] TS 29bb55af476e4a4ebd867d6085de7824 (127.16.58.65:45569): tablet 2527045028f149b6b6ff7f19f04ea7b0 (table test-table [id=211a8f3f2e9944858f803072aab489d8]) successfully deleted
I20260810 01:42:28.592298 28807 ts_tablet_manager.cc:1905] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:28.594076 28807 ts_tablet_manager.cc:1918] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 01:42:28.594152 28807 log.cc:1196] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/2527045028f149b6b6ff7f19f04ea7b0
I20260810 01:42:28.594358 28807 ts_tablet_manager.cc:1939] T 2527045028f149b6b6ff7f19f04ea7b0 P bb4784b7100949219f6bae958ffa6cd9: Deleting consensus metadata
I20260810 01:42:28.594969 27939 catalog_manager.cc:4841] TS bb4784b7100949219f6bae958ffa6cd9 (127.16.58.67:41821): tablet 2527045028f149b6b6ff7f19f04ea7b0 (table test-table [id=211a8f3f2e9944858f803072aab489d8]) successfully deleted
I20260810 01:42:28.599550 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 28308
I20260810 01:42:28.615278 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 28521
I20260810 01:42:28.623955 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 27917
2026-08-10T01:42:28Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3268 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:28 dist-test-slave-jlzn krb5kdc[28904](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:28 dist-test-slave-jlzn krb5kdc[28904](info): set up 2 sockets
Aug 10 01:42:28 dist-test-slave-jlzn krb5kdc[28904](info): commencing operation
krb5kdc: starting...
W20260810 01:42:29.755756 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:29 dist-test-slave-jlzn krb5kdc[28904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:42:29.870373 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39437
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:39437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:29.976910 28934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:29.977147 28934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:29.977190 28934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:29.981070 28934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:29.981119 28934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:29.981145 28934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:29.981182 28934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:29.981209 28934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:29.986191 28934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:39437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:29.987072 28934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:29.988005 28934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:29.995847 28944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:29.995874 28946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:29.995883 28943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:29.996115 28934 server_base.cc:1034] running on GCE node
I20260810 01:42:29.996654 28934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:29.997606 28934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:29.998751 28934 hybrid_clock.cc:648] HybridClock initialized: now 1786326149998732 us; error 33 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T01:42:30Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1374 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:30 dist-test-slave-jlzn krb5kdc[28952](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:30 dist-test-slave-jlzn krb5kdc[28952](info): set up 2 sockets
Aug 10 01:42:30 dist-test-slave-jlzn krb5kdc[28952](info): commencing operation
krb5kdc: starting...
W20260810 01:42:31.135921 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:31 dist-test-slave-jlzn krb5kdc[28952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:42:31.252811 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39295
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:39295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:31.359697 28965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:31.359987 28965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:31.360049 28965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:31.363909 28965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:31.363960 28965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:31.363986 28965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:31.364005 28965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:31.364033 28965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:31.369043 28965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:39295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:31.369949 28965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:31.370882 28965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:31.378727 28974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:31.378710 28979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:31.378710 28977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:31.379159 28965 server_base.cc:1034] running on GCE node
I20260810 01:42:31.379683 28965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:31.380710 28965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:31.381865 28965 hybrid_clock.cc:648] HybridClock initialized: now 1786326151381852 us; error 24 us; skew 500 ppm
Aug 10 01:42:31 dist-test-slave-jlzn krb5kdc[28952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326151, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:31.386909 28965 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:42:31.387759 28965 webserver.cc:460] Webserver started at http://127.16.58.126:40961/ using document root <none> and password file <none>
I20260810 01:42:31.388288 28965 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:31.388352 28965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:31.388527 28965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:31.390419 28965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "6fbbcd00f70f43019803428496aac7d8"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "bddedad89ce70b35beb9a0d2a9034276"
server_key_iv: "cb980d90ec01f26e153f29835853d868"
server_key_version: "encryptionkey@0"
I20260810 01:42:31.390924 28965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "6fbbcd00f70f43019803428496aac7d8"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "bddedad89ce70b35beb9a0d2a9034276"
server_key_iv: "cb980d90ec01f26e153f29835853d868"
server_key_version: "encryptionkey@0"
I20260810 01:42:31.394300 28965 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 01:42:31.396479 28987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:31.397567 28965 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:31.397675 28965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "6fbbcd00f70f43019803428496aac7d8"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "bddedad89ce70b35beb9a0d2a9034276"
server_key_iv: "cb980d90ec01f26e153f29835853d868"
server_key_version: "encryptionkey@0"
I20260810 01:42:31.397761 28965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:31.407855 28965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:31.410296 28965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:31.410461 28965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:31.416893 28965 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:39295
I20260810 01:42:31.416904 29068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:39295 every 8 connection(s)
I20260810 01:42:31.417764 28965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:31.420399 29069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:31.425513 29069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: Bootstrap starting.
I20260810 01:42:31.427758 29069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:31.428000 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 28965
I20260810 01:42:31.428122 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:31.428365 16617 external_mini_cluster.cc:1428] Setting key 97f4f0f2b6cd211f94938af88329685c
I20260810 01:42:31.428547 29069 log.cc:824] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:31.430665 29069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: No bootstrap required, opened a new log
I20260810 01:42:31.434551 29069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } }
I20260810 01:42:31.434813 29069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:31.434887 29069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fbbcd00f70f43019803428496aac7d8, State: Initialized, Role: FOLLOWER
I20260810 01:42:31.435333 29069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } }
I20260810 01:42:31.435495 29069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:31.435565 29069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:31.435668 29069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 0 FOLLOWER]: Advancing to term 1
Aug 10 01:42:31 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:31.436618 29069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } }
I20260810 01:42:31.436910 29069 leader_election.cc:302] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fbbcd00f70f43019803428496aac7d8; no voters:
I20260810 01:42:31.437191 29069 leader_election.cc:288] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:31.437278 29075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:31.437479 29075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 1 LEADER]: Becoming Leader. State: Replica: 6fbbcd00f70f43019803428496aac7d8, State: Running, Role: LEADER
I20260810 01:42:31.437777 29075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } }
I20260810 01:42:31.438365 29069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:31.439343 29077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fbbcd00f70f43019803428496aac7d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } } }
I20260810 01:42:31.439468 29077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:31.439689 29076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fbbcd00f70f43019803428496aac7d8. Latest consensus state: current_term: 1 leader_uuid: "6fbbcd00f70f43019803428496aac7d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } } }
I20260810 01:42:31.440083 29076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:31.440557 29088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:31.442466 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:31.429411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43512 (local address 127.16.58.126:39295)
0810 01:42:31.429775 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:31.429790 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:31.429823 (+ 33us) server_negotiation.cc:407] Connection header received
0810 01:42:31.430411 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:31.430426 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:31.430721 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:31.431000 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:31.431900 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.432837 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.434020 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.434468 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.434576 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:31.437209 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:31.437215 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:31.437231 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:31.437263 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:31.439153 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:31.439669 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:31.439675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:31.439681 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:31.439868 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:31.440184 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:31.440187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:31.440189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:31.440680 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:31.440872 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:31.441300 (+ 428us) server_negotiation.cc:299] Negotiation successful
0810 01:42:31.441591 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":88,"threads_started":1}
I20260810 01:42:31.443192 29088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:31.448287 29088 catalog_manager.cc:1347] Generated new cluster ID: 306e22f27dd4413586aa5d170654a2b3
I20260810 01:42:31.448338 29088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:31.463200 29088 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:31.464094 29088 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:31.472965 29088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: Generated new TSK 0
I20260810 01:42:31.473527 29088 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:42:31.500548 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39295
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:31.609782 29109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:31.610013 29109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:31.610052 29109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:31.613993 29109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:31.614045 29109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:31.614099 29109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:31.619042 29109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:31.619946 29109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:31.620836 29109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:31.629739 29116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:31.629709 29120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:31.629726 29118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:31.629921 29109 server_base.cc:1034] running on GCE node
I20260810 01:42:31.630419 29109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:31.631031 29109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:31.632187 29109 hybrid_clock.cc:648] HybridClock initialized: now 1786326151632174 us; error 27 us; skew 500 ppm
Aug 10 01:42:31 dist-test-slave-jlzn krb5kdc[28952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326151, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:31.634689 29109 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:42:31.635492 29109 webserver.cc:460] Webserver started at http://127.16.58.65:35655/ using document root <none> and password file <none>
I20260810 01:42:31.636062 29109 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:31.636134 29109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:31.636327 29109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:31.638382 29109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "e4629b70220248689e36282f5beb6e37"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "84c164fe18b28a2b11d6c59a05dfe792"
server_key_iv: "bd31cdb9a6eb0a6aa3706a640f39d3ef"
server_key_version: "encryptionkey@0"
I20260810 01:42:31.638945 29109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "e4629b70220248689e36282f5beb6e37"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "84c164fe18b28a2b11d6c59a05dfe792"
server_key_iv: "bd31cdb9a6eb0a6aa3706a640f39d3ef"
server_key_version: "encryptionkey@0"
I20260810 01:42:31.642431 29109 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:42:31.644654 29127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:31.645745 29109 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:31.645845 29109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "e4629b70220248689e36282f5beb6e37"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "84c164fe18b28a2b11d6c59a05dfe792"
server_key_iv: "bd31cdb9a6eb0a6aa3706a640f39d3ef"
server_key_version: "encryptionkey@0"
I20260810 01:42:31.645936 29109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:31.659296 29109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:31.661728 29109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:31.661890 29109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:31.662438 29109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:31.663218 29109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:31.663265 29109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:31.663307 29109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:31.663335 29109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:31.671675 29109 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:43025
I20260810 01:42:31.671702 29300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:43025 every 8 connection(s)
I20260810 01:42:31.672530 29109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:31.676605 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 29109
I20260810 01:42:31.676712 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:31.676971 16617 external_mini_cluster.cc:1428] Setting key aeeb4ed43298a0013bfcefb02ff5cdb8
Aug 10 01:42:31 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326151, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:31.685616 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:31.674241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:58499 (local address 127.16.58.126:39295)
0810 01:42:31.674381 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:31.674386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:31.675408 (+ 1022us) server_negotiation.cc:407] Connection header received
0810 01:42:31.676261 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:31.676263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:31.676310 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:31.676382 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:31.677541 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.678141 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.679282 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.679581 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.679684 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:31.682238 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:31.682241 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:31.682243 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:31.682266 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:31.683585 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:31.684176 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:31.684178 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:31.684179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:31.684250 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:31.684602 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:31.684604 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:31.684605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:31.684762 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:31.684832 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:31.685395 (+ 563us) server_negotiation.cc:299] Negotiation successful
0810 01:42:31.685490 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:42:31.686637 29305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:31.674637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:58499)
0810 01:42:31.675274 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:31.675314 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:31.676065 (+ 751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:31.676527 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:31.676533 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:31.676917 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:31.677413 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:31.677427 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.678267 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.678270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:31.679155 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:31.679166 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.679704 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.679706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:31.679877 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:31.680451 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:31.680471 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:31.682072 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:31.683700 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:31.683707 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:31.683721 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:31.684078 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:31.684333 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:31.684336 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:31.684338 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:31.684518 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:31.684854 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:31.684860 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:31.685169 (+ 309us) client_negotiation.cc:769] Sending connection context
0810 01:42:31.685362 (+ 193us) client_negotiation.cc:240] Negotiation successful
0810 01:42:31.685678 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:42:31.687861 29301 heartbeater.cc:347] Connected to a master server at 127.16.58.126:39295
I20260810 01:42:31.688077 29301 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:31.688503 29301 heartbeater.cc:511] Master 127.16.58.126:39295 requested a full tablet report, sending...
I20260810 01:42:31.689976 29014 ts_manager.cc:194] Registered new tserver with Master: e4629b70220248689e36282f5beb6e37 (127.16.58.65:43025)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
I20260810 01:42:31.691175 29014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:58499
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:42:31.704124 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39295
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:31.811878 29310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:31.812114 29310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:31.812171 29310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:31.816051 29310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:31.816102 29310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:31.816175 29310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:31.821152 29310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:31.822104 29310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:31.823055 29310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:31.832319 29320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:31.832331 29323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:31.832357 29318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:31.832381 29310 server_base.cc:1034] running on GCE node
I20260810 01:42:31.832939 29310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:31.833549 29310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:31.834718 29310 hybrid_clock.cc:648] HybridClock initialized: now 1786326151834698 us; error 29 us; skew 500 ppm
Aug 10 01:42:31 dist-test-slave-jlzn krb5kdc[28952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326151, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:31.837380 29310 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:42:31.838258 29310 webserver.cc:460] Webserver started at http://127.16.58.66:35731/ using document root <none> and password file <none>
I20260810 01:42:31.838805 29310 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:31.838876 29310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:31.839159 29310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:31.841248 29310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "42df52b3bda9409bb0f637dc738372e2"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "ed09043c8f904af07ca23cb6c0a15405"
server_key_iv: "a1ab3d023dd2064e593a645ebcd14f9a"
server_key_version: "encryptionkey@0"
I20260810 01:42:31.841751 29310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "42df52b3bda9409bb0f637dc738372e2"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "ed09043c8f904af07ca23cb6c0a15405"
server_key_iv: "a1ab3d023dd2064e593a645ebcd14f9a"
server_key_version: "encryptionkey@0"
I20260810 01:42:31.845192 29310 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:31.847410 29334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:31.848598 29310 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:31.848699 29310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "42df52b3bda9409bb0f637dc738372e2"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "ed09043c8f904af07ca23cb6c0a15405"
server_key_iv: "a1ab3d023dd2064e593a645ebcd14f9a"
server_key_version: "encryptionkey@0"
I20260810 01:42:31.848793 29310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:31.859457 29310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:31.861927 29310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:31.862097 29310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:31.862651 29310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:31.863458 29310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:31.863508 29310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:31.863566 29310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:31.863597 29310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:31.871987 29310 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:34637
I20260810 01:42:31.872015 29510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:34637 every 8 connection(s)
I20260810 01:42:31.872812 29310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:31.879716 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 29310
I20260810 01:42:31.879839 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:31.880138 16617 external_mini_cluster.cc:1428] Setting key c7232e16a5ba60da5688169cea8b7e2f
Aug 10 01:42:31 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326151, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:31.885202 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:31.874552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:54207 (local address 127.16.58.126:39295)
0810 01:42:31.874691 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:31.874695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:31.875691 (+ 996us) server_negotiation.cc:407] Connection header received
0810 01:42:31.876502 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:31.876505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:31.876551 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:31.876623 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:31.877659 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.878178 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.879222 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.879446 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.879540 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:31.881931 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:31.881935 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:31.881938 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:31.881966 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:31.883333 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:31.883834 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:31.883838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:31.883840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:31.883924 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:31.884236 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:31.884240 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:31.884242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:31.884422 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:31.884508 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:31.884972 (+ 464us) server_negotiation.cc:299] Negotiation successful
0810 01:42:31.885081 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:31.886157 29516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:31.874930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:54207)
0810 01:42:31.875540 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:31.875578 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:31.876346 (+ 768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:31.876761 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:31.876767 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:31.877092 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:31.877550 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:31.877563 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.878262 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.878264 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:31.879133 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:31.879142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:31.879569 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:31.879571 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:31.879709 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:31.880284 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:31.880301 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:31.881773 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:31.883436 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:31.883441 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:31.883451 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:31.883710 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:31.884010 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:31.884012 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:31.884014 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:31.884148 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:31.884522 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:31.884528 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:31.884760 (+ 232us) client_negotiation.cc:769] Sending connection context
0810 01:42:31.884929 (+ 169us) client_negotiation.cc:240] Negotiation successful
0810 01:42:31.885228 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":112,"threads_started":1}
I20260810 01:42:31.887198 29511 heartbeater.cc:347] Connected to a master server at 127.16.58.126:39295
I20260810 01:42:31.887439 29511 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:31.888031 29511 heartbeater.cc:511] Master 127.16.58.126:39295 requested a full tablet report, sending...
I20260810 01:42:31.889088 29014 ts_manager.cc:194] Registered new tserver with Master: 42df52b3bda9409bb0f637dc738372e2 (127.16.58.66:34637)
I20260810 01:42:31.889627 29014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:54207
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:42:31.906075 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39295
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:32.013000 29522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:32.013249 29522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:32.013309 29522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:32.017182 29522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:32.017231 29522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:32.017306 29522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:32.022276 29522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:39295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:32.023208 29522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:32.024189 29522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:32.033277 29528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:32.033277 29531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:32.033329 29529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:32.033488 29522 server_base.cc:1034] running on GCE node
I20260810 01:42:32.033895 29522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:32.034452 29522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:32.035598 29522 hybrid_clock.cc:648] HybridClock initialized: now 1786326152035579 us; error 29 us; skew 500 ppm
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326152, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:32.038208 29522 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:42:32.039032 29522 webserver.cc:460] Webserver started at http://127.16.58.67:38317/ using document root <none> and password file <none>
I20260810 01:42:32.039585 29522 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:32.039667 29522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:32.039913 29522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:32.041811 29522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "e990a9f25ddc407c8e15505502366b7f"
format_stamp: "Formatted at 2026-08-10 01:42:32 on dist-test-slave-jlzn"
server_key: "98a43c61aea196cae68588484052da10"
server_key_iv: "31f0f85eadfb6b204ab6d709e089e1cf"
server_key_version: "encryptionkey@0"
I20260810 01:42:32.042414 29522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "e990a9f25ddc407c8e15505502366b7f"
format_stamp: "Formatted at 2026-08-10 01:42:32 on dist-test-slave-jlzn"
server_key: "98a43c61aea196cae68588484052da10"
server_key_iv: "31f0f85eadfb6b204ab6d709e089e1cf"
server_key_version: "encryptionkey@0"
I20260810 01:42:32.045842 29522 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:42:32.048045 29545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.049198 29522 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:32.049300 29522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "e990a9f25ddc407c8e15505502366b7f"
format_stamp: "Formatted at 2026-08-10 01:42:32 on dist-test-slave-jlzn"
server_key: "98a43c61aea196cae68588484052da10"
server_key_iv: "31f0f85eadfb6b204ab6d709e089e1cf"
server_key_version: "encryptionkey@0"
I20260810 01:42:32.049386 29522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:32.068702 29522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:32.071198 29522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:32.071364 29522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:32.071962 29522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:32.072754 29522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:32.072803 29522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.072855 29522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:32.072885 29522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.081007 29522 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:46109
I20260810 01:42:32.081035 29725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:46109 every 8 connection(s)
I20260810 01:42:32.081825 29522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326152, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:32.091223 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 29522
I20260810 01:42:32.091360 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:32.091645 16617 external_mini_cluster.cc:1428] Setting key b28e164b848bbce0ccafa2626a78f03a
I20260810 01:42:32.094424 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.083477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:33363 (local address 127.16.58.126:39295)
0810 01:42:32.083606 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.083610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.084610 (+ 1000us) server_negotiation.cc:407] Connection header received
0810 01:42:32.085471 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.085475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.085538 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.085609 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.086715 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.087247 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.088411 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.088629 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.088718 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.090943 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:32.090946 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:32.090948 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:32.090973 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:32.092556 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:32.093070 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:32.093073 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:32.093075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:32.093161 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:32.093486 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:32.093490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:32.093491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:32.093713 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:32.093798 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:32.094215 (+ 417us) server_negotiation.cc:299] Negotiation successful
0810 01:42:32.094306 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:32.095196 29730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.083833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:33363)
0810 01:42:32.084475 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.084516 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.085262 (+ 746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.085790 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.085797 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.086130 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.086571 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.086584 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.087365 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.087368 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.088287 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.088298 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.088765 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.088769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.088926 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.089416 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.089431 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.090783 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:32.092665 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:32.092671 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:32.092684 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:32.092984 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:32.093240 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:32.093243 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:32.093245 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:32.093400 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:32.093810 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:32.093815 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:32.094024 (+ 209us) client_negotiation.cc:769] Sending connection context
0810 01:42:32.094178 (+ 154us) client_negotiation.cc:240] Negotiation successful
0810 01:42:32.094406 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":110,"threads_started":1}
I20260810 01:42:32.096194 29726 heartbeater.cc:347] Connected to a master server at 127.16.58.126:39295
I20260810 01:42:32.096388 29726 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:32.096796 29726 heartbeater.cc:511] Master 127.16.58.126:39295 requested a full tablet report, sending...
I20260810 01:42:32.097698 29014 ts_manager.cc:194] Registered new tserver with Master: e990a9f25ddc407c8e15505502366b7f (127.16.58.67:46109)
I20260810 01:42:32.098218 29014 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:33363
I20260810 01:42:32.105082 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab.
Entry for principal oryx/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab.
WARNING: no policy specified for oryx/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab.
Entry for principal oryx/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab.
WARNING: no policy specified for oryx/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab.
Entry for principal oryx/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab.
I20260810 01:42:32.169603 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 29109
I20260810 01:42:32.184937 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 29310
I20260810 01:42:32.202371 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 29522
I20260810 01:42:32.218601 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 28965
I20260810 01:42:32.227311 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39295
--webserver_interface=127.16.58.126
--webserver_port=40961
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:39295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:32.334818 29743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:32.335062 29743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:32.335112 29743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:32.339028 29743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:32.339084 29743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:32.339116 29743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:32.339146 29743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:32.339175 29743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:32.344233 29743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:39295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:39295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=40961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:32.345160 29743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:32.346103 29743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:32.354233 29743 server_base.cc:1034] running on GCE node
W20260810 01:42:32.354185 29748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:32.354218 29754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:32.354185 29749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:32.354979 29743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:32.355980 29743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:32.357136 29743 hybrid_clock.cc:648] HybridClock initialized: now 1786326152357118 us; error 28 us; skew 500 ppm
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326152, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:32.359680 29743 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:42:32.360522 29743 webserver.cc:460] Webserver started at http://127.16.58.126:40961/ using document root <none> and password file <none>
I20260810 01:42:32.361030 29743 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:32.361109 29743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:32.364710 29743 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260810 01:42:32.366619 29766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.367717 29743 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:32.367847 29743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "6fbbcd00f70f43019803428496aac7d8"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "bddedad89ce70b35beb9a0d2a9034276"
server_key_iv: "cb980d90ec01f26e153f29835853d868"
server_key_version: "encryptionkey@0"
I20260810 01:42:32.368342 29743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:32.387169 29743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:32.389714 29743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:32.389882 29743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:32.396451 29743 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:39295
I20260810 01:42:32.396507 29841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:39295 every 8 connection(s)
I20260810 01:42:32.397439 29743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:32.401562 29842 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:42:32.402897 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 29743
I20260810 01:42:32.403144 29842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: Bootstrap starting.
I20260810 01:42:32.403326 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:43025
--local_ip_for_outbound_sockets=127.16.58.65
--tserver_master_addrs=127.16.58.126:39295
--webserver_port=35655
--webserver_interface=127.16.58.65
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.16.58.65
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:42:32.425005 29842 log.cc:824] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:32.433223 29842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:42:32.433610 29842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: Bootstrap complete.
I20260810 01:42:32.439105 29842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } }
I20260810 01:42:32.439613 29842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fbbcd00f70f43019803428496aac7d8, State: Initialized, Role: FOLLOWER
I20260810 01:42:32.440181 29842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } }
I20260810 01:42:32.440325 29842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:32.440390 29842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:32.440483 29842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:42:32.442824 29842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } }
I20260810 01:42:32.443190 29842 leader_election.cc:302] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fbbcd00f70f43019803428496aac7d8; no voters:
I20260810 01:42:32.443519 29842 leader_election.cc:288] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 01:42:32.443627 29852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:42:32.443899 29852 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [term 2 LEADER]: Becoming Leader. State: Replica: 6fbbcd00f70f43019803428496aac7d8, State: Running, Role: LEADER
I20260810 01:42:32.444228 29852 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } }
I20260810 01:42:32.444730 29842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:32.445060 29857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fbbcd00f70f43019803428496aac7d8. Latest consensus state: current_term: 2 leader_uuid: "6fbbcd00f70f43019803428496aac7d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } } }
I20260810 01:42:32.445196 29857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:32.445441 29856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6fbbcd00f70f43019803428496aac7d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fbbcd00f70f43019803428496aac7d8" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 39295 } } }
I20260810 01:42:32.445524 29856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:32.446771 29859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:32.450008 29859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:32.450675 29859 catalog_manager.cc:1259] Loaded cluster ID: 306e22f27dd4413586aa5d170654a2b3
I20260810 01:42:32.450737 29859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:32.453198 29859 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:32.453860 29859 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6fbbcd00f70f43019803428496aac7d8: Loaded TSK: 0
I20260810 01:42:32.455029 29859 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:42:32.526945 29844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:32.527169 29844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:32.527225 29844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:32.531155 29844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:32.531204 29844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:32.531261 29844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:32.536259 29844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.65.keytab
--principal=oryx/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:43025
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=35655
--tserver_master_addrs=127.16.58.126:39295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:32.537153 29844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:32.538067 29844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:32.548295 29889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:32.548301 29891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:32.548314 29894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:32.549332 29844 server_base.cc:1034] running on GCE node
I20260810 01:42:32.549690 29844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:32.550290 29844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:32.551456 29844 hybrid_clock.cc:648] HybridClock initialized: now 1786326152551434 us; error 31 us; skew 500 ppm
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326152, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:32.554018 29844 init.cc:377] Logged in from keytab as oryx/127.16.58.65@KRBTEST.COM (short username oryx)
I20260810 01:42:32.554840 29844 webserver.cc:460] Webserver started at http://127.16.58.65:35655/ using document root <none> and password file <none>
I20260810 01:42:32.555358 29844 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:32.555429 29844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:32.559141 29844 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:32.561163 29910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.562281 29844 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:32.562373 29844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "e4629b70220248689e36282f5beb6e37"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "84c164fe18b28a2b11d6c59a05dfe792"
server_key_iv: "bd31cdb9a6eb0a6aa3706a640f39d3ef"
server_key_version: "encryptionkey@0"
I20260810 01:42:32.562879 29844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:32.572170 29844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:32.574954 29844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:32.575110 29844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:32.575651 29844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:32.576447 29844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:32.576493 29844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.576534 29844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:32.576561 29844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.585691 29844 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:43025
I20260810 01:42:32.585723 30080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:43025 every 8 connection(s)
I20260810 01:42:32.586594 29844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:32.590888 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 29844
I20260810 01:42:32.591399 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:34637
--local_ip_for_outbound_sockets=127.16.58.66
--tserver_master_addrs=127.16.58.126:39295
--webserver_port=35731
--webserver_interface=127.16.58.66
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.16.58.66
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 01:42:32.599206 30084 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:32.588423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:52763 (local address 127.16.58.126:39295)
0810 01:42:32.588823 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.588838 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.589323 (+ 485us) server_negotiation.cc:407] Connection header received
0810 01:42:32.590294 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.590305 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.590566 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.590833 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.592264 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.593373 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.594501 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.595157 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.595312 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.598575 (+ 3263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:52763: BlockingRecv error: recv got EOF from 127.16.58.65:52763 (error 108)
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":90,"threads_started":1}
I20260810 01:42:32.599314 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.588510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:52763)
0810 01:42:32.589174 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.589224 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.589973 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.590967 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.590977 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.591428 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.592077 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.592098 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.593518 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.593521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.594377 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.594387 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.595285 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.595288 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.595413 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.595952 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.595969 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.598405 (+ 2436us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":105,"threads_started":1}
W20260810 01:42:32.599890 30081 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:39295 (0 consecutive failures): Not authorized: Failed to ping master at 127.16.58.126:39295: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:32.605226 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.600296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:46505)
0810 01:42:32.600515 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.600528 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.600608 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.600817 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.600819 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.600960 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.601040 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.601045 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.601862 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.601866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.602425 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.602434 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.602838 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.602841 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.602936 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.603387 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.603399 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.605113 (+ 1714us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160}
W20260810 01:42:32.605340 30084 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:32.600407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:46505 (local address 127.16.58.126:39295)
0810 01:42:32.600511 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.600515 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.600569 (+ 54us) server_negotiation.cc:407] Connection header received
0810 01:42:32.600686 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.600690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.600731 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.600795 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.601241 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.601756 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.602544 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.602745 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.602825 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.605243 (+ 2418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:46505: BlockingRecv error: recv got EOF from 127.16.58.65:46505 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:32.610575 30087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.605799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:41441)
0810 01:42:32.605941 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.605954 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.606028 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.606243 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.606245 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.606355 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.606419 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.606424 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.607354 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.607357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.607917 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.607926 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.608443 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.608446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.608502 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.608921 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.608931 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.610488 (+ 1557us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":87}
W20260810 01:42:32.610737 30084 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:32.605896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:41441 (local address 127.16.58.126:39295)
0810 01:42:32.606006 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.606010 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.606023 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:32.606089 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.606091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.606131 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.606210 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.606506 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.607257 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.608009 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.608345 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.608440 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.610635 (+ 2195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:41441: BlockingRecv error: recv got EOF from 127.16.58.65:41441 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 01:42:32.610796 30081 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:42:32.703658 30088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:32.703904 30088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:32.703949 30088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:32.707768 30088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:32.707839 30088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:32.707904 30088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:32.712951 30088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.66.keytab
--principal=oryx/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:34637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=35731
--tserver_master_addrs=127.16.58.126:39295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:32.713855 30088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:32.714771 30088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:32.723820 30102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:32.723886 30088 server_base.cc:1034] running on GCE node
W20260810 01:42:32.723832 30097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:32.723870 30096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:32.724411 30088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:32.724968 30088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:32.726125 30088 hybrid_clock.cc:648] HybridClock initialized: now 1786326152726101 us; error 35 us; skew 500 ppm
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326152, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:32.728866 30088 init.cc:377] Logged in from keytab as oryx/127.16.58.66@KRBTEST.COM (short username oryx)
I20260810 01:42:32.729660 30088 webserver.cc:460] Webserver started at http://127.16.58.66:35731/ using document root <none> and password file <none>
I20260810 01:42:32.730160 30088 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:32.730243 30088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:32.733824 30088 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:32.735651 30112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.736760 30088 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:32.736877 30088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "42df52b3bda9409bb0f637dc738372e2"
format_stamp: "Formatted at 2026-08-10 01:42:31 on dist-test-slave-jlzn"
server_key: "ed09043c8f904af07ca23cb6c0a15405"
server_key_iv: "a1ab3d023dd2064e593a645ebcd14f9a"
server_key_version: "encryptionkey@0"
I20260810 01:42:32.737365 30088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:32.765290 30088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:32.768319 30088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:32.768491 30088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:32.769068 30088 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:32.769881 30088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:32.769928 30088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.769980 30088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:32.770009 30088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.778151 30088 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:34637
I20260810 01:42:32.778196 30296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:34637 every 8 connection(s)
I20260810 01:42:32.779096 30088 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:32.788399 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 30088
I20260810 01:42:32.788901 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:46109
--local_ip_for_outbound_sockets=127.16.58.67
--tserver_master_addrs=127.16.58.126:39295
--webserver_port=38317
--webserver_interface=127.16.58.67
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.16.58.67
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:32.789212 30084 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:32.780771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:52765 (local address 127.16.58.126:39295)
0810 01:42:32.780896 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.780900 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.781885 (+ 985us) server_negotiation.cc:407] Connection header received
0810 01:42:32.782735 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.782738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.782798 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.782872 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.783985 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.784509 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.785607 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.785830 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.785919 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.789080 (+ 3161us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:52765: BlockingRecv error: recv got EOF from 127.16.58.66:52765 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:42:32.789827 30301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.781129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:52765)
0810 01:42:32.781744 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.781785 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.782529 (+ 744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.783047 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.783053 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.783376 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.783838 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.783853 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.784627 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.784636 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.785480 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.785490 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.785965 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.785970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.786125 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.786581 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.786596 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.788944 (+ 2348us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":109,"threads_started":1}
W20260810 01:42:32.790251 30297 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:39295 (0 consecutive failures): Not authorized: Failed to ping master at 127.16.58.126:39295: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:32.795420 30301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.790649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:45021)
0810 01:42:32.790840 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.790854 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.790926 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.791140 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.791142 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.791265 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.791347 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.791351 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.792295 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.792297 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.792816 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.792823 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.793316 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.793318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.793378 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.793769 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.793780 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.795335 (+ 1555us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121}
W20260810 01:42:32.795584 30084 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:32.790736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:45021 (local address 127.16.58.126:39295)
0810 01:42:32.790849 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.790853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.790895 (+ 42us) server_negotiation.cc:407] Connection header received
0810 01:42:32.790995 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.790998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.791041 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.791116 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.791436 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.792194 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.792924 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.793225 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.793321 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.795480 (+ 2159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:45021: BlockingRecv error: recv got EOF from 127.16.58.66:45021 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:32.800107 30301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.795875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:57005)
0810 01:42:32.795963 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.795977 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.796060 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.796268 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.796271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.796403 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.796465 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.796470 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.797137 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.797140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.797628 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.797635 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.798031 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.798034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.798117 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.798489 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.798501 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.799990 (+ 1489us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 01:42:32.800202 30084 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:32.795935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:57005 (local address 127.16.58.126:39295)
0810 01:42:32.796039 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.796043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.796056 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:32.796139 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.796142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.796180 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.796244 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.796562 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.797037 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.797727 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.797940 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.798021 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.800108 (+ 2087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:57005: BlockingRecv error: recv got EOF from 127.16.58.66:57005 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 01:42:32.800287 30297 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:42:32.900444 30302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:32.900665 30302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:32.900710 30302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:32.904532 30302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:32.904579 30302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:32.904649 30302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:32.909572 30302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/krb5kdc/oryx_127.16.58.67.keytab
--principal=oryx/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:46109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=38317
--tserver_master_addrs=127.16.58.126:39295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:32.910463 30302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:32.911367 30302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:32.920104 30309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:32.920110 30308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:32.920120 30311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:32.920451 30302 server_base.cc:1034] running on GCE node
I20260810 01:42:32.920883 30302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:32.921456 30302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:32.922612 30302 hybrid_clock.cc:648] HybridClock initialized: now 1786326152922595 us; error 28 us; skew 500 ppm
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326152, etypes {rep=17 tkt=17 ses=17}, oryx/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:32.925256 30302 init.cc:377] Logged in from keytab as oryx/127.16.58.67@KRBTEST.COM (short username oryx)
I20260810 01:42:32.926008 30302 webserver.cc:460] Webserver started at http://127.16.58.67:38317/ using document root <none> and password file <none>
I20260810 01:42:32.926504 30302 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:32.926584 30302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:32.930205 30302 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:32.932102 30322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.933187 30302 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:32.933295 30302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "e990a9f25ddc407c8e15505502366b7f"
format_stamp: "Formatted at 2026-08-10 01:42:32 on dist-test-slave-jlzn"
server_key: "98a43c61aea196cae68588484052da10"
server_key_iv: "31f0f85eadfb6b204ab6d709e089e1cf"
server_key_version: "encryptionkey@0"
I20260810 01:42:32.933771 30302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:32.945609 30302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:32.948352 30302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:32.948519 30302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:32.949030 30302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:32.949795 30302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:32.949842 30302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.949891 30302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:32.949918 30302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:32.958007 30302 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:46109
I20260810 01:42:32.958030 30489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:46109 every 8 connection(s)
I20260810 01:42:32.958906 30302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:32.965925 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 30302
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
W20260810 01:42:32.969604 30084 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:32.960506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:56851 (local address 127.16.58.126:39295)
0810 01:42:32.960668 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.960673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.961893 (+ 1220us) server_negotiation.cc:407] Connection header received
0810 01:42:32.962673 (+ 780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.962675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.962722 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.962791 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.964228 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.964739 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.965879 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.966152 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.966232 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.969481 (+ 3249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:56851: BlockingRecv error: recv got EOF from 127.16.58.67:56851 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:42:32.970153 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.960873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:56851)
0810 01:42:32.961758 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.961798 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.962503 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.962981 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.962990 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.963475 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.964087 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.964103 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.964825 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.964827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.965744 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.965786 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.966298 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.966303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.966457 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.967070 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.967090 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.969362 (+ 2272us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":574,"threads_started":1}
W20260810 01:42:32.970561 30490 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:39295 (0 consecutive failures): Not authorized: Failed to ping master at 127.16.58.126:39295: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:32.975582 30494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.966911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43984 (local address 127.16.58.126:39295)
0810 01:42:32.967164 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.967168 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.967180 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:32.967216 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.967219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.967262 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.967356 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.968059 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.968574 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.969427 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.969648 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.969743 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.971596 (+ 1853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:32.971604 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:32.971622 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:32.971656 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:32.973451 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:32.973918 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:32.973923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:32.973927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:32.974078 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:32.974345 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:32.974348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:32.974350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:32.974728 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:32.974905 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:32.975201 (+ 296us) server_negotiation.cc:299] Negotiation successful
0810 01:42:32.975422 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":79,"threads_started":1}
I20260810 01:42:32.976573 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.970933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:40297)
0810 01:42:32.971018 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.971031 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.971100 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.971300 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.971303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.971436 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.971543 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.971551 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.972390 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.972393 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.973181 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.973192 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.973612 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.973614 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.973688 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.974052 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.974065 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.976465 (+ 2400us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260810 01:42:32.976671 30084 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:32.971011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:40297 (local address 127.16.58.126:39295)
0810 01:42:32.971110 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.971113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.971151 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:42:32.971182 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.971185 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.971219 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.971275 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.971659 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.972285 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.973299 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.973504 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.973603 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.976582 (+ 2979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:40297: BlockingRecv error: recv got EOF from 127.16.58.67:40297 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:32 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:32.981274 30492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:32.977025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:57357)
0810 01:42:32.977199 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:32.977212 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:32.977288 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:32.977490 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:32.977492 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:32.977661 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:32.977749 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.977756 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.978507 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.978510 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.978999 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:32.979006 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.979333 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.979335 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:32.979386 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.979738 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:32.979749 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:32.981196 (+ 1447us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 01:42:32.981375 30084 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:32.977088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:57357 (local address 127.16.58.126:39295)
0810 01:42:32.977209 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:32.977213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:32.977251 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:42:32.977352 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:32.977355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:32.977390 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:32.977457 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:32.977855 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.978420 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.979079 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:32.979266 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:32.979327 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:32.981291 (+ 1964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:57357: BlockingRecv error: recv got EOF from 127.16.58.67:57357 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260810 01:42:32.981442 30490 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 01:42:33 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:33 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:33.616602 30496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:33.611316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:60169)
0810 01:42:33.611590 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:33.611604 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:33.611689 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:33.611923 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:33.611925 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:33.612116 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:33.612214 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:33.612220 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.612916 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.612918 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:33.613599 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:33.613613 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.614148 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.614152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:33.614235 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:33.614725 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:33.614740 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:33.616459 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":72,"threads_started":1}
W20260810 01:42:33.616710 30498 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:33.611384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:60169 (local address 127.16.58.126:39295)
0810 01:42:33.611654 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:33.611658 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:33.611670 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:33.611763 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:33.611765 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:33.611827 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:33.611901 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:33.612296 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.612829 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.613744 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.614030 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.614119 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:33.616591 (+ 2472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:60169: BlockingRecv error: recv got EOF from 127.16.58.65:60169 (error 108)
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":101,"threads_started":1}
Aug 10 01:42:33 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:33 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:33.806221 30499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:33.800893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:40399)
0810 01:42:33.801175 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:33.801190 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:33.801292 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:33.801524 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:33.801526 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:33.801710 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:33.801810 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:33.801816 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.802535 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.802539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:33.803136 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:33.803146 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.803621 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.803626 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:33.803719 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:33.804275 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:33.804290 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:33.806094 (+ 1804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":92,"threads_started":1}
W20260810 01:42:33.806332 30498 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:33.800977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:40399 (local address 127.16.58.126:39295)
0810 01:42:33.801118 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:33.801123 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:33.801254 (+ 131us) server_negotiation.cc:407] Connection header received
0810 01:42:33.801361 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:33.801364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:33.801408 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:33.801475 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:33.801898 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.802419 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.803233 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.803500 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.803594 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:33.806227 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:40399: BlockingRecv error: recv got EOF from 127.16.58.66:40399 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 01:42:33 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:33 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:33.987085 30500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:33.981958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:53721)
0810 01:42:33.982222 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:33.982234 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:33.982327 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:33.982566 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:33.982569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:33.982794 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:33.982914 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:33.982921 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.983778 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.983781 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:33.984409 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:33.984420 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.984812 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.984815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:33.984872 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:33.985316 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:33.985327 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:33.986968 (+ 1641us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":69,"threads_started":1}
W20260810 01:42:33.987205 30498 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:33.982033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:53721 (local address 127.16.58.126:39295)
0810 01:42:33.982154 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:33.982158 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:33.982322 (+ 164us) server_negotiation.cc:407] Connection header received
0810 01:42:33.982417 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:33.982419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:33.982472 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:33.982556 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:33.983026 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.983672 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.984511 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:33.984728 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:33.984806 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:33.987092 (+ 2286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:53721: BlockingRecv error: recv got EOF from 127.16.58.67:53721 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 10 01:42:34 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:34 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:34.622457 30501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:34.617255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:52451)
0810 01:42:34.617515 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:34.617528 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:34.617611 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:34.617805 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:34.617806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:34.617984 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:34.618078 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:34.618084 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.618826 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.618828 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:34.619393 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:34.619401 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.619869 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.619872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:34.619956 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:34.620533 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:34.620548 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:34.622322 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":85,"threads_started":1}
W20260810 01:42:34.622558 30502 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:34.617337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:52451 (local address 127.16.58.126:39295)
0810 01:42:34.617612 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:34.617615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:34.617628 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:34.617668 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:34.617670 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:34.617710 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:34.617784 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:34.618192 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.618746 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.619470 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.619735 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.619868 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:34.622452 (+ 2584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:52451: BlockingRecv error: recv got EOF from 127.16.58.65:52451 (error 108)
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":90,"threads_started":1}
Aug 10 01:42:34 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:34 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:34.812099 30503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:34.806892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:51919)
0810 01:42:34.807171 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:34.807186 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:34.807290 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:34.807527 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:34.807530 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:34.807731 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:34.807854 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:34.807862 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.808608 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.808611 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:34.809178 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:34.809187 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.809614 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.809618 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:34.809700 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:34.810180 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:34.810192 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:34.811918 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":86,"threads_started":1}
W20260810 01:42:34.812144 30502 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:34.806975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:51919 (local address 127.16.58.126:39295)
0810 01:42:34.807108 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:34.807113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:34.807247 (+ 134us) server_negotiation.cc:407] Connection header received
0810 01:42:34.807378 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:34.807381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:34.807428 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:34.807492 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:34.807965 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.808487 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.809289 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.809511 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.809597 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:34.812050 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:51919: BlockingRecv error: recv got EOF from 127.16.58.66:51919 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 01:42:34 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:34 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:34.992796 30504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:34.987774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:37643)
0810 01:42:34.988051 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:34.988067 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:34.988193 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:34.988458 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:34.988461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:34.988642 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:34.988741 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:34.988746 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.989418 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.989420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:34.989962 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:34.989967 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.990369 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.990372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:34.990431 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:34.990907 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:34.990919 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:34.992653 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":81,"threads_started":1}
W20260810 01:42:34.992874 30502 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:34.987921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:37643 (local address 127.16.58.126:39295)
0810 01:42:34.988044 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:34.988049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:34.988122 (+ 73us) server_negotiation.cc:407] Connection header received
0810 01:42:34.988288 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:34.988291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:34.988348 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:34.988426 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:34.988826 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.989343 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.990056 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:34.990288 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:34.990365 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:34.992771 (+ 2406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:37643: BlockingRecv error: recv got EOF from 127.16.58.67:37643 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 01:42:35 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:35 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:35.628378 30506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:35.623190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:51049)
0810 01:42:35.623487 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:35.623500 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:35.623596 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:35.623835 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:35.623837 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:35.624017 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:35.624117 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:35.624123 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.624934 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.624936 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:35.625501 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:35.625507 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.625919 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.625921 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:35.625981 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:35.626420 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:35.626431 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:35.628260 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":113,"threads_started":1}
W20260810 01:42:35.628515 30507 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:35.623283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:51049 (local address 127.16.58.126:39295)
0810 01:42:35.623501 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:35.623506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:35.623548 (+ 42us) server_negotiation.cc:407] Connection header received
0810 01:42:35.623677 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:35.623679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:35.623720 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:35.623790 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:35.624204 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.624845 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.625609 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.625831 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.625912 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:35.628391 (+ 2479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:51049: BlockingRecv error: recv got EOF from 127.16.58.65:51049 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":55,"threads_started":1}
Aug 10 01:42:35 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:35 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:35.818182 30508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:35.812846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:51663)
0810 01:42:35.813124 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:35.813139 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:35.813260 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:35.813502 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:35.813504 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:35.813691 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:35.813792 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:35.813798 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.814465 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.814467 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:35.815037 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:35.815045 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.815399 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.815402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:35.815460 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:35.816027 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:35.816042 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:35.818064 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":96,"threads_started":1}
W20260810 01:42:35.818297 30507 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:35.812909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:51663 (local address 127.16.58.126:39295)
0810 01:42:35.813049 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:35.813054 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:35.813218 (+ 164us) server_negotiation.cc:407] Connection header received
0810 01:42:35.813354 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:35.813357 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:35.813407 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:35.813470 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:35.813879 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.814386 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.815119 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.815325 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.815391 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:35.818184 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:51663: BlockingRecv error: recv got EOF from 127.16.58.66:51663 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 01:42:35 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:35 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:35.998234 30510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:35.993430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:52157)
0810 01:42:35.993675 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:35.993691 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:35.993785 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:35.993988 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:35.993990 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:35.994180 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:35.994276 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:35.994281 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.994946 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.994948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:35.995502 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:35.995509 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.995881 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.995884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:35.995946 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:35.996420 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:35.996432 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:35.998113 (+ 1681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":71,"threads_started":1}
W20260810 01:42:35.998356 30507 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:35.993485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:52157 (local address 127.16.58.126:39295)
0810 01:42:35.993613 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:35.993617 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:35.993750 (+ 133us) server_negotiation.cc:407] Connection header received
0810 01:42:35.993854 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:35.993856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:35.993902 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:35.993966 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:35.994358 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.994868 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.995580 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:35.995779 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:35.995871 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:35.998238 (+ 2367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:52157: BlockingRecv error: recv got EOF from 127.16.58.67:52157 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 10 01:42:36 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:36 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:36.637382 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:36.629078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:45247)
0810 01:42:36.629348 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:36.629362 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:36.629456 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:36.629675 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:36.629677 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:36.629851 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:36.629949 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:36.629955 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:36.630641 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:36.630643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:36.631196 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:36.631202 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:36.631567 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:36.631569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:36.631639 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:36.635444 (+ 3805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:36.635455 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:36.637264 (+ 1809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":86,"threads_started":1}
W20260810 01:42:36.637522 30517 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:36.629137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:45247 (local address 127.16.58.126:39295)
0810 01:42:36.629357 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:36.629361 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:36.629410 (+ 49us) server_negotiation.cc:407] Connection header received
0810 01:42:36.629526 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:36.629528 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:36.629570 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:36.629648 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:36.630030 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:36.630560 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:36.631272 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:36.631478 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:36.631557 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:36.637391 (+ 5834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:45247: BlockingRecv error: recv got EOF from 127.16.58.65:45247 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":68,"threads_started":1}
Aug 10 01:42:36 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:36 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:36.823763 30518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:36.818870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:49153)
0810 01:42:36.819196 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:36.819211 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:36.819316 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:36.819599 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:36.819602 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:36.819793 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:36.819932 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:36.819938 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:36.820613 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:36.820615 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:36.821173 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:36.821179 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:36.821521 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:36.821523 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:36.821580 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:36.822019 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:36.822030 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:36.823644 (+ 1614us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":101,"threads_started":1}
W20260810 01:42:36.824050 30517 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:36.818898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:49153 (local address 127.16.58.126:39295)
0810 01:42:36.819054 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:36.819059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:36.819274 (+ 215us) server_negotiation.cc:407] Connection header received
0810 01:42:36.819427 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:36.819431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:36.819499 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:36.819561 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:36.820021 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:36.820532 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:36.821250 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:36.821449 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:36.821514 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:36.823782 (+ 2268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:49153: BlockingRecv error: recv got EOF from 127.16.58.66:49153 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 10 01:42:36 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:36 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:37.004032 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:36.998888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:56889)
0810 01:42:36.999152 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:36.999166 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:36.999272 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:36.999539 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:36.999542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:36.999733 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:36.999859 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:36.999868 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.000621 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.000625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:37.001178 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:37.001186 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.001625 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.001628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:37.001710 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:37.002140 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:37.002151 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:37.003879 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":89,"threads_started":1}
W20260810 01:42:37.004146 30517 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:36.998947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:56889 (local address 127.16.58.126:39295)
0810 01:42:36.999099 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:36.999105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:36.999229 (+ 124us) server_negotiation.cc:407] Connection header received
0810 01:42:36.999358 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:36.999362 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:36.999413 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:36.999483 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:36.999969 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.000514 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.001293 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.001523 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.001612 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:37.004043 (+ 2431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:56889: BlockingRecv error: recv got EOF from 127.16.58.67:56889 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 10 01:42:37 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:37 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:37.643064 30520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:37.638086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:38197)
0810 01:42:37.638375 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:37.638389 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:37.638486 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:37.638709 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:37.638712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:37.638892 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:37.638989 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:37.638994 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.639666 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.639668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:37.640296 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:37.640305 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.640707 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.640710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:37.640777 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:37.641238 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:37.641249 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:37.642946 (+ 1697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":105,"threads_started":1}
W20260810 01:42:37.643209 30521 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:37.638160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:38197 (local address 127.16.58.126:39295)
0810 01:42:37.638396 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:37.638400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:37.638452 (+ 52us) server_negotiation.cc:407] Connection header received
0810 01:42:37.638557 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:37.638560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:37.638605 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:37.638684 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:37.639068 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.639590 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.640386 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.640608 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.640688 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:37.643074 (+ 2386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:38197: BlockingRecv error: recv got EOF from 127.16.58.65:38197 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":59,"threads_started":1}
Aug 10 01:42:37 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:37 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:37.829435 30523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:37.824579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:34527)
0810 01:42:37.824868 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:37.824881 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:37.824970 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:37.825169 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:37.825171 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:37.825355 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:37.825475 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:37.825481 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.826143 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.826145 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:37.826707 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:37.826713 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.827061 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.827063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:37.827130 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:37.827579 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:37.827590 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:37.829300 (+ 1710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":105,"threads_started":1}
W20260810 01:42:37.829535 30521 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:37.824722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:34527 (local address 127.16.58.126:39295)
0810 01:42:37.824869 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:37.824874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:37.824927 (+ 53us) server_negotiation.cc:407] Connection header received
0810 01:42:37.825044 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:37.825046 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:37.825088 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:37.825147 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:37.825557 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.826070 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.826781 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:37.826989 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:37.827056 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:37.829426 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:34527: BlockingRecv error: recv got EOF from 127.16.58.66:34527 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 01:42:38 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:38 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:38.009727 30524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:38.004858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:51913)
0810 01:42:38.005142 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:38.005156 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:38.005248 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:38.005442 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:38.005444 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:38.005629 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:38.005724 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:38.005729 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.006409 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.006412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:38.006976 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:38.006984 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.007349 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.007351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:38.007408 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:38.007886 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:38.007897 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:38.009596 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":102,"threads_started":1}
W20260810 01:42:38.009831 30521 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:38.004937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:51913 (local address 127.16.58.126:39295)
0810 01:42:38.005067 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:38.005072 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:38.005207 (+ 135us) server_negotiation.cc:407] Connection header received
0810 01:42:38.005311 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:38.005313 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:38.005358 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:38.005419 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:38.005803 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.006319 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.007054 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.007270 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.007340 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:38.009721 (+ 2381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:51913: BlockingRecv error: recv got EOF from 127.16.58.67:51913 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 10 01:42:38 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:38 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:38.649035 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:38.643776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:37221)
0810 01:42:38.644063 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:38.644077 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:38.644179 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:38.644390 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:38.644392 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:38.644575 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:38.644671 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:38.644677 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.645409 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.645412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:38.646041 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:38.646052 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.646439 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.646442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:38.646498 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:38.646947 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:38.646959 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:38.648889 (+ 1930us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":89,"threads_started":1}
W20260810 01:42:38.649273 30527 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:38.643860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:37221 (local address 127.16.58.126:39295)
0810 01:42:38.644087 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:38.644091 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:38.644122 (+ 31us) server_negotiation.cc:407] Connection header received
0810 01:42:38.644249 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:38.644251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:38.644296 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:38.644369 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:38.644765 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.645324 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.646128 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.646360 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.646431 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:38.649020 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:37221: BlockingRecv error: recv got EOF from 127.16.58.65:37221 (error 108)
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":60,"threads_started":1}
Aug 10 01:42:38 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:38 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:38.834967 30528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:38.830121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:54025)
0810 01:42:38.830415 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:38.830429 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:38.830526 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:38.830734 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:38.830736 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:38.830921 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:38.831022 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:38.831027 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.831711 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.831713 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:38.832305 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:38.832315 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.832671 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.832673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:38.832731 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:38.833221 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:38.833233 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:38.834851 (+ 1618us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":107,"threads_started":1}
W20260810 01:42:38.835089 30527 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:38.830191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:54025 (local address 127.16.58.126:39295)
0810 01:42:38.830310 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:38.830313 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:38.830487 (+ 174us) server_negotiation.cc:407] Connection header received
0810 01:42:38.830589 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:38.830591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:38.830641 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:38.830705 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:38.831103 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.831632 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.832392 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:38.832589 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:38.832663 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:38.834974 (+ 2311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:54025: BlockingRecv error: recv got EOF from 127.16.58.66:54025 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 01:42:39 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:39 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:39.015842 30529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:39.010435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:36877)
0810 01:42:39.010704 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:39.010718 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:39.010829 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:39.011065 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:39.011068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:39.011284 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:39.011381 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:39.011387 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.012198 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.012202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:39.012805 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:39.012816 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.013256 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.013260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:39.013348 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:39.013874 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:39.013887 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:39.015665 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":87,"threads_started":1}
W20260810 01:42:39.015928 30527 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:39.010517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:36877 (local address 127.16.58.126:39295)
0810 01:42:39.010647 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:39.010652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:39.010784 (+ 132us) server_negotiation.cc:407] Connection header received
0810 01:42:39.010915 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:39.010918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:39.010967 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:39.011029 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:39.011506 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.012097 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.012925 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.013154 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.013241 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:39.015826 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:36877: BlockingRecv error: recv got EOF from 127.16.58.67:36877 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 01:42:39 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:39 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:39.655014 30531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:39.649734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:47553)
0810 01:42:39.650040 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:39.650053 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:39.650163 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:39.650378 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:39.650380 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:39.650564 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:39.650662 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:39.650667 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.651419 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.651423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:39.652183 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:39.652196 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.652639 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.652642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:39.652706 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:39.653197 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:39.653212 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:39.654901 (+ 1689us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":68,"threads_started":1}
W20260810 01:42:39.655148 30533 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:39.649805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:47553 (local address 127.16.58.126:39295)
0810 01:42:39.650053 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:39.650057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:39.650110 (+ 53us) server_negotiation.cc:407] Connection header received
0810 01:42:39.650245 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:39.650247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:39.650291 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:39.650355 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:39.650740 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.651308 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.652300 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.652538 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.652612 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:39.655027 (+ 2415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:47553: BlockingRecv error: recv got EOF from 127.16.58.65:47553 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":83,"threads_started":1}
Aug 10 01:42:39 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:39 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:39.840969 30534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:39.835736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:60457)
0810 01:42:39.836060 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:39.836074 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:39.836172 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:39.836372 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:39.836374 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:39.836609 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:39.836722 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:39.836729 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.837455 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.837457 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:39.838043 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:39.838052 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.838440 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.838442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:39.838500 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:39.838938 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:39.838949 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:39.840794 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":84,"threads_started":1}
W20260810 01:42:39.841054 30533 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:39.835819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:60457 (local address 127.16.58.126:39295)
0810 01:42:39.835956 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:39.835961 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:39.836146 (+ 185us) server_negotiation.cc:407] Connection header received
0810 01:42:39.836236 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:39.836239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:39.836284 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:39.836348 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:39.836840 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.837369 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.838138 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:39.838357 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:39.838433 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:39.840954 (+ 2521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:60457: BlockingRecv error: recv got EOF from 127.16.58.66:60457 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 10 01:42:40 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:40 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:40.021934 30539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:40.016637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:44579)
0810 01:42:40.016926 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:40.016939 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:40.017039 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:40.017239 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:40.017241 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:40.017423 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:40.017519 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:40.017524 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.018245 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.018247 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:40.018829 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:40.018837 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.019297 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.019301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:40.019389 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:40.019966 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:40.019981 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:40.021785 (+ 1804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":78,"threads_started":1}
W20260810 01:42:40.022136 30533 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:40.016698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:44579 (local address 127.16.58.126:39295)
0810 01:42:40.016873 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:40.016878 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:40.017007 (+ 129us) server_negotiation.cc:407] Connection header received
0810 01:42:40.017110 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:40.017112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:40.017161 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:40.017226 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:40.017643 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.018162 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.018950 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.019186 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.019295 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:40.021921 (+ 2626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:44579: BlockingRecv error: recv got EOF from 127.16.58.67:44579 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 10 01:42:40 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:40 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:40.660725 30540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:40.655751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:51947)
0810 01:42:40.656042 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:40.656058 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:40.656146 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:40.656368 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:40.656370 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:40.656553 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:40.656663 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:40.656670 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.657357 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.657359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:40.657920 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:40.657928 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.658288 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.658291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:40.658347 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:40.658821 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:40.658832 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:40.660597 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":103,"threads_started":1}
W20260810 01:42:40.660861 30541 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:40.655883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:51947 (local address 127.16.58.126:39295)
0810 01:42:40.656100 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:40.656104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:40.656117 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:42:40.656234 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:40.656236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:40.656280 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:40.656345 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:40.656748 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.657278 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.657997 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.658215 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.658281 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:40.660730 (+ 2449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:51947: BlockingRecv error: recv got EOF from 127.16.58.65:51947 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":67,"threads_started":1}
Aug 10 01:42:40 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:40 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:40.847332 30542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:40.841877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:33397)
0810 01:42:40.842139 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:40.842153 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:40.842255 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:40.842479 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:40.842482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:40.842693 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:40.842797 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:40.842803 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.843610 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.843612 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:40.844277 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:40.844290 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.844742 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.844746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:40.844831 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:40.845414 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:40.845427 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:40.847214 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":97,"threads_started":1}
W20260810 01:42:40.847457 30541 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:40.841929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:33397 (local address 127.16.58.126:39295)
0810 01:42:40.842081 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:40.842085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:40.842215 (+ 130us) server_negotiation.cc:407] Connection header received
0810 01:42:40.842323 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:40.842325 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:40.842369 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:40.842432 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:40.842882 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.843531 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.844385 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:40.844625 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:40.844728 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:40.847340 (+ 2612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:33397: BlockingRecv error: recv got EOF from 127.16.58.66:33397 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 01:42:41 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:41 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:41.027985 30543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:41.022655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:44929)
0810 01:42:41.022901 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:41.022914 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:41.023013 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:41.023297 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:41.023299 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:41.023476 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:41.023593 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:41.023600 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.024531 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.024534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:41.025092 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:41.025100 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.025464 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.025467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:41.025525 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:41.026109 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:41.026122 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:41.027867 (+ 1745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":74,"threads_started":1}
W20260810 01:42:41.028095 30541 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:41.022727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:44929 (local address 127.16.58.126:39295)
0810 01:42:41.022849 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:41.022853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:41.022962 (+ 109us) server_negotiation.cc:407] Connection header received
0810 01:42:41.023106 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:41.023109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:41.023169 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:41.023245 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:41.023720 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.024435 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.025184 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.025393 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.025458 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:41.027989 (+ 2531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:44929: BlockingRecv error: recv got EOF from 127.16.58.67:44929 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 10 01:42:41 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:41 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:41.670710 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:41.661482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:40793)
0810 01:42:41.661784 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:41.661798 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:41.661895 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:41.662135 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:41.662137 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:41.662316 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:41.662416 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:41.662421 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.663137 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.663139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:41.663694 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:41.663701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.664096 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.664098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:41.664168 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:41.668522 (+ 4354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:41.668538 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:41.670567 (+ 2029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":82,"threads_started":1}
W20260810 01:42:41.670822 30547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:41.661539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:40793 (local address 127.16.58.126:39295)
0810 01:42:41.661809 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:41.661813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:41.661848 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:42:41.661968 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:41.661970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:41.662027 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:41.662104 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:41.662506 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.663048 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.663775 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.664015 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.664088 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:41.670707 (+ 6619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:40793: BlockingRecv error: recv got EOF from 127.16.58.65:40793 (error 108)
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":89,"threads_started":1}
Aug 10 01:42:41 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:41 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:41.853462 30549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:41.848015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:38011)
0810 01:42:41.848278 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:41.848292 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:41.848392 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:41.848619 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:41.848622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:41.848811 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:41.848909 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:41.848914 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.849604 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.849606 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:41.850222 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:41.850234 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.850774 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.850779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:41.850868 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:41.851569 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:41.851582 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:41.853346 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":82,"threads_started":1}
W20260810 01:42:41.853585 30547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:41.848075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:38011 (local address 127.16.58.126:39295)
0810 01:42:41.848212 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:41.848218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:41.848353 (+ 135us) server_negotiation.cc:407] Connection header received
0810 01:42:41.848460 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:41.848463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:41.848529 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:41.848594 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:41.848988 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.849524 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.850358 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:41.850653 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:41.850763 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:41.853479 (+ 2716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:38011: BlockingRecv error: recv got EOF from 127.16.58.66:38011 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 01:42:42 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:42 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:42.033981 30550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:42.028838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:41581)
0810 01:42:42.029098 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:42.029112 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:42.029224 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:42.029502 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:42.029505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:42.029695 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:42.029794 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:42.029800 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.030485 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.030487 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:42.031031 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:42.031037 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.031386 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.031388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:42.031447 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:42.031949 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:42.031960 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:42.033802 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":86,"threads_started":1}
W20260810 01:42:42.034041 30547 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:42.028872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:41581 (local address 127.16.58.126:39295)
0810 01:42:42.029010 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:42.029015 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:42.029185 (+ 170us) server_negotiation.cc:407] Connection header received
0810 01:42:42.029314 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:42.029317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:42.029376 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:42.029455 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:42.029886 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.030405 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.031106 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.031311 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.031380 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:42.033940 (+ 2560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:41581: BlockingRecv error: recv got EOF from 127.16.58.67:41581 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 10 01:42:42 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:42 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:42.676548 30551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:42.671401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:56065)
0810 01:42:42.671696 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:42.671709 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:42.671817 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:42.672020 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:42.672022 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:42.672205 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:42.672305 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:42.672310 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.673083 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.673086 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:42.673658 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:42.673667 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.674021 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.674023 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:42.674082 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:42.674529 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:42.674544 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:42.676430 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":79,"threads_started":1}
W20260810 01:42:42.676673 30552 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:42.671448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:56065 (local address 127.16.58.126:39295)
0810 01:42:42.671710 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:42.671714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:42.671770 (+ 56us) server_negotiation.cc:407] Connection header received
0810 01:42:42.671884 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:42.671886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:42.671927 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:42.671999 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:42.672387 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.672987 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.673742 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.673950 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.674014 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:42.676559 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:56065: BlockingRecv error: recv got EOF from 127.16.58.65:56065 (error 108)
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":113,"threads_started":1}
Aug 10 01:42:42 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:42 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:42.859102 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:42.854317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:58627)
0810 01:42:42.854572 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:42.854585 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:42.854687 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:42.854895 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:42.854897 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:42.855078 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:42.855178 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:42.855184 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.855870 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.855872 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:42.856425 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:42.856433 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.856799 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.856802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:42.856857 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:42.857293 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:42.857304 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:42.858982 (+ 1678us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":81,"threads_started":1}
W20260810 01:42:42.859218 30552 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:42.854377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:58627 (local address 127.16.58.126:39295)
0810 01:42:42.854514 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:42.854519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:42.854646 (+ 127us) server_negotiation.cc:407] Connection header received
0810 01:42:42.854768 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:42.854770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:42.854816 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:42.854871 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:42.855257 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.855780 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.856506 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:42.856724 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:42.856790 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:42.859115 (+ 2325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:58627: BlockingRecv error: recv got EOF from 127.16.58.66:58627 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 01:42:43 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:43 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:43.039983 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:43.034710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:45699)
0810 01:42:43.034994 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:43.035010 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:43.035117 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:43.035360 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:43.035363 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:43.035568 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:43.035679 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:43.035685 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.036467 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.036471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:43.037046 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:43.037054 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.037531 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.037534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:43.037632 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:43.038058 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:43.038069 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:43.039831 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":105,"threads_started":1}
W20260810 01:42:43.040062 30552 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:43.034846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:45699 (local address 127.16.58.126:39295)
0810 01:42:43.034994 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:43.034998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:43.035066 (+ 68us) server_negotiation.cc:407] Connection header received
0810 01:42:43.035205 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:43.035208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:43.035258 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:43.035323 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:43.035794 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.036354 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.037166 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.037413 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.037506 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:43.039964 (+ 2458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:45699: BlockingRecv error: recv got EOF from 127.16.58.67:45699 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 10 01:42:43 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:43 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:43.682248 30559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:43.677279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:57531)
0810 01:42:43.677552 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:43.677566 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:43.677666 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:43.677882 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:43.677885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:43.678082 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:43.678186 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:43.678192 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.678880 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.678882 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:43.679446 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:43.679453 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.679843 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.679845 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:43.679904 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:43.680380 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:43.680391 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:43.682132 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":81,"threads_started":1}
W20260810 01:42:43.682380 30558 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:43.677295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:57531 (local address 127.16.58.126:39295)
0810 01:42:43.677555 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:43.677559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:43.677616 (+ 57us) server_negotiation.cc:407] Connection header received
0810 01:42:43.677741 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:43.677743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:43.677787 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:43.677850 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:43.678272 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.678804 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.679525 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.679740 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.679826 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:43.682260 (+ 2434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:57531: BlockingRecv error: recv got EOF from 127.16.58.65:57531 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":83,"threads_started":1}
Aug 10 01:42:43 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:43 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:43.864850 30560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:43.859796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:38913)
0810 01:42:43.860092 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:43.860107 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:43.860206 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:43.860414 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:43.860416 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:43.860600 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:43.860714 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:43.860720 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.861403 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.861405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:43.861960 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:43.861967 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.862321 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.862323 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:43.862379 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:43.862885 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:43.862898 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:43.864680 (+ 1782us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":90,"threads_started":1}
W20260810 01:42:43.864918 30558 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:43.859886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:38913 (local address 127.16.58.126:39295)
0810 01:42:43.860012 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:43.860016 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:43.860166 (+ 150us) server_negotiation.cc:407] Connection header received
0810 01:42:43.860274 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:43.860276 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:43.860320 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:43.860391 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:43.860803 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.861324 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.862037 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:43.862245 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:43.862312 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:43.864819 (+ 2507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:38913: BlockingRecv error: recv got EOF from 127.16.58.66:38913 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 01:42:44 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:44 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:44.045825 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:44.040790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:42907)
0810 01:42:44.041079 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:44.041093 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:44.041194 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:44.041411 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:44.041415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:44.041597 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:44.041701 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:44.041706 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.042386 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.042389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:44.042940 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:44.042946 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.043293 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.043295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:44.043352 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:44.043837 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:44.043853 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:44.045684 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":93,"threads_started":1}
W20260810 01:42:44.045934 30558 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:44.040835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:42907 (local address 127.16.58.126:39295)
0810 01:42:44.040964 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:44.040969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:44.041156 (+ 187us) server_negotiation.cc:407] Connection header received
0810 01:42:44.041258 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:44.041261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:44.041307 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:44.041372 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:44.041792 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.042312 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.043014 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.043220 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.043285 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:44.045817 (+ 2532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:42907: BlockingRecv error: recv got EOF from 127.16.58.67:42907 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 10 01:42:44 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:44 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:44.687898 30563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:44.683008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:49731)
0810 01:42:44.683276 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:44.683290 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:44.683373 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:44.683588 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:44.683590 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:44.683775 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:44.683899 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:44.683905 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.684584 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.684586 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:44.685137 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:44.685145 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.685498 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.685500 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:44.685558 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:44.686019 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:44.686029 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:44.687747 (+ 1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":84,"threads_started":1}
W20260810 01:42:44.688026 30562 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:44.683022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:49731 (local address 127.16.58.126:39295)
0810 01:42:44.683298 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:44.683302 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:44.683343 (+ 41us) server_negotiation.cc:407] Connection header received
0810 01:42:44.683453 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:44.683455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:44.683499 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:44.683565 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:44.683981 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.684512 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.685218 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.685425 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.685490 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:44.687909 (+ 2419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:49731: BlockingRecv error: recv got EOF from 127.16.58.65:49731 (error 108)
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":98,"threads_started":1}
Aug 10 01:42:44 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:44 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:44.871954 30564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:44.865650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:56677)
0810 01:42:44.865912 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:44.865926 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:44.866041 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:44.866304 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:44.866307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:44.866527 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:44.866627 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:44.866641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.867541 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.867544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:44.868401 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:44.868415 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.868989 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.868992 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:44.869092 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:44.869612 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:44.869629 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:44.871769 (+ 2140us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":85,"threads_started":1}
W20260810 01:42:44.872076 30562 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:44.865723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:56677 (local address 127.16.58.126:39295)
0810 01:42:44.865855 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:44.865860 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:44.865997 (+ 137us) server_negotiation.cc:407] Connection header received
0810 01:42:44.866123 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:44.866126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:44.866198 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:44.866263 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:44.866772 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.867411 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.868524 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:44.868852 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:44.868957 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:44.871971 (+ 3014us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:56677: BlockingRecv error: recv got EOF from 127.16.58.66:56677 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 10 01:42:45 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:45 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:45.051923 30565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:45.046476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:58315)
0810 01:42:45.046773 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:45.046786 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:45.046897 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:45.047149 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:45.047152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:45.047350 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:45.047447 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:45.047452 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.048261 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.048265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:45.048830 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:45.048839 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.049271 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.049275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:45.049364 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:45.049886 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:45.049901 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:45.051786 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":109,"threads_started":1}
W20260810 01:42:45.052063 30562 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:45.046539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:58315 (local address 127.16.58.126:39295)
0810 01:42:45.046668 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:45.046674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:45.046853 (+ 179us) server_negotiation.cc:407] Connection header received
0810 01:42:45.046984 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:45.046987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:45.047038 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:45.047103 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:45.047558 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.048157 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.048942 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.049171 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.049256 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:45.051944 (+ 2688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:58315: BlockingRecv error: recv got EOF from 127.16.58.67:58315 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 01:42:45 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:45 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:45.693714 30566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:45.688571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:43775)
0810 01:42:45.688860 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:45.688873 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:45.688972 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:45.689190 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:45.689192 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:45.689373 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:45.689466 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:45.689471 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.690175 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.690178 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:45.690751 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:45.690760 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.691184 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.691186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:45.691257 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:45.691836 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:45.691850 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:45.693577 (+ 1727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":95,"threads_started":1}
W20260810 01:42:45.693825 30568 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:45.688628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:43775 (local address 127.16.58.126:39295)
0810 01:42:45.688861 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:45.688864 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:45.688923 (+ 59us) server_negotiation.cc:407] Connection header received
0810 01:42:45.689043 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:45.689045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:45.689088 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:45.689169 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:45.689547 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.690077 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.690855 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.691085 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.691162 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:45.693710 (+ 2548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:43775: BlockingRecv error: recv got EOF from 127.16.58.65:43775 (error 108)
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":58,"threads_started":1}
Aug 10 01:42:45 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:45 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:45.878088 30569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:45.872768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:56101)
0810 01:42:45.873035 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:45.873050 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:45.873154 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:45.873368 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:45.873369 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:45.873549 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:45.873651 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:45.873657 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.874320 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.874322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:45.874873 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:45.874879 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.875268 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.875272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:45.875352 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:45.875874 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:45.875890 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:45.877925 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":83,"threads_started":1}
W20260810 01:42:45.878166 30568 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:45.872886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:56101 (local address 127.16.58.126:39295)
0810 01:42:45.873009 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:45.873013 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:45.873107 (+ 94us) server_negotiation.cc:407] Connection header received
0810 01:42:45.873236 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:45.873239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:45.873283 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:45.873340 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:45.873733 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.874246 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.874949 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:45.875170 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:45.875235 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:45.878064 (+ 2829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:56101: BlockingRecv error: recv got EOF from 127.16.58.66:56101 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 01:42:46 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:46 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:46.058723 30571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:46.052650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:55183)
0810 01:42:46.054002 (+ 1352us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:46.054015 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:46.054122 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:46.054380 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:46.054383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:46.054620 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:46.054728 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:46.054735 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.055449 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.055451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:46.056044 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:46.056052 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.056415 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.056417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:46.056472 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:46.056958 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:46.056971 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:46.058597 (+ 1626us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1283,"thread_start_us":1161,"threads_started":1}
W20260810 01:42:46.058835 30568 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:46.052716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:55183 (local address 127.16.58.126:39295)
0810 01:42:46.052841 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:46.052846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:46.054088 (+ 1242us) server_negotiation.cc:407] Connection header received
0810 01:42:46.054210 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:46.054213 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:46.054263 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:46.054332 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:46.054828 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.055367 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.056125 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.056340 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.056408 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:46.058719 (+ 2311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:55183: BlockingRecv error: recv got EOF from 127.16.58.67:55183 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 01:42:46 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:46 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:46.702876 30572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:46.694400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:49861)
0810 01:42:46.694679 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:46.694692 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:46.694782 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:46.694984 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:46.694986 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:46.695177 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:46.695275 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:46.695280 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.696011 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.696014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:46.696591 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:46.696599 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.696952 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.696955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:46.697012 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:46.701075 (+ 4063us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:46.701088 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:46.702753 (+ 1665us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":90,"threads_started":1}
W20260810 01:42:46.702996 30573 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:46.694474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:49861 (local address 127.16.58.126:39295)
0810 01:42:46.694761 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:46.694764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:46.694776 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:42:46.694847 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:46.694849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:46.694890 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:46.694960 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:46.695357 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.695932 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.696671 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.696881 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.696944 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:46.702881 (+ 5937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:49861: BlockingRecv error: recv got EOF from 127.16.58.65:49861 (error 108)
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":63,"threads_started":1}
Aug 10 01:42:46 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:46 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:46.883832 30574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:46.878800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:38087)
0810 01:42:46.879054 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:46.879067 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:46.879169 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:46.879373 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:46.879374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:46.879552 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:46.879652 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:46.879658 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.880368 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.880371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:46.880938 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:46.880947 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.881311 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.881313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:46.881370 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:46.881853 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:46.881865 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:46.883643 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":79,"threads_started":1}
W20260810 01:42:46.883896 30573 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:46.878849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:38087 (local address 127.16.58.126:39295)
0810 01:42:46.878967 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:46.878971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:46.879121 (+ 150us) server_negotiation.cc:407] Connection header received
0810 01:42:46.879238 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:46.879241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:46.879284 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:46.879346 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:46.879732 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.880283 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.881022 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:46.881235 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:46.881302 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:46.883768 (+ 2466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:38087: BlockingRecv error: recv got EOF from 127.16.58.66:38087 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 10 01:42:47 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:47 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.67@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:47.064693 30575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:47.059375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.67:50957)
0810 01:42:47.059671 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:47.059683 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:47.059793 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:47.060045 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:47.060048 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:47.060255 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:47.060351 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:47.060357 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.061105 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.061108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:47.061689 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:47.061698 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.062123 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.062127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:47.062210 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:47.062661 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:47.062671 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:47.064519 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":91,"threads_started":1}
W20260810 01:42:47.064757 30573 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:47.059458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:50957 (local address 127.16.58.126:39295)
0810 01:42:47.059592 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:47.059597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:47.059749 (+ 152us) server_negotiation.cc:407] Connection header received
0810 01:42:47.059897 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:47.059900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:47.059947 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:47.060010 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:47.060462 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.060999 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.061801 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.062024 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.062109 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:47.064656 (+ 2547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.67:50957: BlockingRecv error: recv got EOF from 127.16.58.67:50957 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 10 01:42:47 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:47 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.65@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:47.708869 30576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:47.703686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.65:57239)
0810 01:42:47.704007 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:47.704022 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:47.704118 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:47.704339 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:47.704341 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:47.704549 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:47.704649 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:47.704655 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.705350 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.705353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:47.705949 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:47.705959 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.706315 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.706317 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:47.706377 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:47.706866 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:47.706877 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:47.708741 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":128,"threads_started":1}
W20260810 01:42:47.709025 30581 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:47.703775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:57239 (local address 127.16.58.126:39295)
0810 01:42:47.704041 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:47.704045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:47.704071 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:42:47.704193 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:47.704195 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:47.704239 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:47.704311 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:47.704736 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.705257 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.706035 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.706240 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.706302 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:47.708894 (+ 2592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.65:57239: BlockingRecv error: recv got EOF from 127.16.58.65:57239 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":55,"threads_started":1}
Aug 10 01:42:47 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
Aug 10 01:42:47 dist-test-slave-jlzn krb5kdc[28952](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.16.58.66@KRBTEST.COM for oryx/127.16.58.126@KRBTEST.COM, Server not found in Kerberos database
I20260810 01:42:47.889544 30583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:47.884682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:39295 (local address 127.16.58.66:54051)
0810 01:42:47.884944 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:47.884956 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:47.885046 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:47.885248 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:47.885250 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:47.885431 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:47.885526 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:47.885532 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.886204 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.886206 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:47.886775 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:47.886782 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.887138 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.887140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:47.887194 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:47.887650 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:47.887661 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:47.889392 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.16.58.126:39295: Server oryx/127.16.58.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":71,"threads_started":1}
W20260810 01:42:47.889671 30581 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:47.884755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:54051 (local address 127.16.58.126:39295)
0810 01:42:47.884907 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:47.884912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:47.885002 (+ 90us) server_negotiation.cc:407] Connection header received
0810 01:42:47.885118 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:47.885120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:47.885166 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:47.885221 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:47.885607 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.886129 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.886855 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:47.887056 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:47.887122 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:47.889525 (+ 2403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.16.58.66:54051: BlockingRecv error: recv got EOF from 127.16.58.66:54051 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:42:47.967630 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 29844
I20260810 01:42:47.978430 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 30088
I20260810 01:42:47.987282 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 30302
I20260810 01:42:47.997165 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 29743
2026-08-10T01:42:48Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17992 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T01:42:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:48Z Disabled control of system clock
I20260810 01:42:48.029709 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:34369
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:32919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:34369
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 01:42:48.136250 30589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:48.136476 30589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:48.136508 30589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:48.140419 30589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:48.140470 30589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:48.140484 30589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:48.140498 30589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:48.140511 30589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:48.145109 30589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:34369
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:34369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:48.146095 30589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:48.147411 30589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:48.155820 30589 server_base.cc:1034] running on GCE node
W20260810 01:42:48.155903 30599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:48.155771 30596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:48.155791 30597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:48.156518 30589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:48.157492 30589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:48.158674 30589 hybrid_clock.cc:648] HybridClock initialized: now 1786326168158655 us; error 32 us; skew 500 ppm
I20260810 01:42:48.160423 30589 webserver.cc:460] Webserver started at http://127.16.58.126:41549/ using document root <none> and password file <none>
I20260810 01:42:48.161130 30589 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:48.161222 30589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:48.161465 30589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:48.163409 30589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "1856249affb04abba9fcfc503f90d121"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "84fb8f73728f6d2591fc9d64e9b42ed0"
server_key_iv: "bf88c289f96cf3dd2252e85911265118"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.163944 30589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "1856249affb04abba9fcfc503f90d121"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "84fb8f73728f6d2591fc9d64e9b42ed0"
server_key_iv: "bf88c289f96cf3dd2252e85911265118"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.167209 30589 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:42:48.169425 30607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.170504 30589 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260810 01:42:48.170603 30589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "1856249affb04abba9fcfc503f90d121"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "84fb8f73728f6d2591fc9d64e9b42ed0"
server_key_iv: "bf88c289f96cf3dd2252e85911265118"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.170693 30589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:48.179553 30589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:48.180157 30589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:48.180295 30589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:48.186553 30589 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:34369
I20260810 01:42:48.186568 30682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:34369 every 8 connection(s)
I20260810 01:42:48.187419 30589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:48.190479 30683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:48.194813 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 30589
I20260810 01:42:48.194904 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:48.195158 16617 external_mini_cluster.cc:1428] Setting key aed1a55958a5470fbbd6b74ec39e04fa
I20260810 01:42:48.195916 30683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121: Bootstrap starting.
I20260810 01:42:48.198248 30683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:48.199112 30683 log.cc:824] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:48.201114 30683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121: No bootstrap required, opened a new log
I20260810 01:42:48.204272 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:48.196527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39960 (local address 127.16.58.126:34369)
0810 01:42:48.197137 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:48.197152 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:48.197185 (+ 33us) server_negotiation.cc:407] Connection header received
0810 01:42:48.197777 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:48.197793 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:48.198196 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:48.198483 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:48.198826 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.200065 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.201222 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.201686 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.201805 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:48.202609 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:48.202614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:48.202637 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:48.202987 (+ 350us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:48.203044 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:48.203063 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:48.203139 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:48.203288 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 01:42:48.203531 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":124,"threads_started":1}
I20260810 01:42:48.204835 30683 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1856249affb04abba9fcfc503f90d121" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34369 } }
I20260810 01:42:48.205039 30683 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:48.205094 30683 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1856249affb04abba9fcfc503f90d121, State: Initialized, Role: FOLLOWER
I20260810 01:42:48.205520 30683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1856249affb04abba9fcfc503f90d121" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34369 } }
I20260810 01:42:48.205673 30683 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:48.205729 30683 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:48.205807 30683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:48.206668 30683 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1856249affb04abba9fcfc503f90d121" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34369 } }
I20260810 01:42:48.206957 30683 leader_election.cc:302] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1856249affb04abba9fcfc503f90d121; no voters:
I20260810 01:42:48.207209 30683 leader_election.cc:288] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:48.207305 30690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:48.207525 30690 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [term 1 LEADER]: Becoming Leader. State: Replica: 1856249affb04abba9fcfc503f90d121, State: Running, Role: LEADER
I20260810 01:42:48.207880 30690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1856249affb04abba9fcfc503f90d121" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34369 } }
I20260810 01:42:48.208408 30683 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:48.209367 30691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1856249affb04abba9fcfc503f90d121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1856249affb04abba9fcfc503f90d121" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34369 } } }
I20260810 01:42:48.209492 30691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:48.209811 30693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1856249affb04abba9fcfc503f90d121. Latest consensus state: current_term: 1 leader_uuid: "1856249affb04abba9fcfc503f90d121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1856249affb04abba9fcfc503f90d121" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34369 } } }
I20260810 01:42:48.209959 30693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:48.209875 30702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:48.212536 30702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:48.217831 30702 catalog_manager.cc:1347] Generated new cluster ID: 6dd9977ad1594c2f8a38c871537a07b2
I20260810 01:42:48.217885 30702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:48.237551 30702 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:48.238395 30702 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:48.244280 30702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1856249affb04abba9fcfc503f90d121: Generated new TSK 0
I20260810 01:42:48.244990 30702 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:42:48.252544 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34369
--builtin_ntp_servers=127.16.58.84:32919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 01:42:48.363379 30715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:48.363595 30715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:48.363643 30715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:48.367491 30715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:48.367538 30715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:48.367607 30715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:48.372146 30715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:48.373082 30715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:48.374394 30715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:48.383296 30715 server_base.cc:1034] running on GCE node
W20260810 01:42:48.383234 30725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:48.383252 30724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:48.383272 30728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:48.383965 30715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:48.384553 30715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:48.385718 30715 hybrid_clock.cc:648] HybridClock initialized: now 1786326168385699 us; error 32 us; skew 500 ppm
I20260810 01:42:48.387403 30715 webserver.cc:460] Webserver started at http://127.16.58.65:37163/ using document root <none> and password file <none>
I20260810 01:42:48.387976 30715 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:48.388046 30715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:48.388270 30715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:48.390162 30715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "371f863e004047bdac8d9af79aaadf41"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "9f88463d83e3f01be4408a00a9493734"
server_key_iv: "6d2cb687878bf40bdc575932c5a3018f"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.390667 30715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "371f863e004047bdac8d9af79aaadf41"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "9f88463d83e3f01be4408a00a9493734"
server_key_iv: "6d2cb687878bf40bdc575932c5a3018f"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.394083 30715 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260810 01:42:48.396310 30734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.397387 30715 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:48.397491 30715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "371f863e004047bdac8d9af79aaadf41"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "9f88463d83e3f01be4408a00a9493734"
server_key_iv: "6d2cb687878bf40bdc575932c5a3018f"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.397581 30715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:48.413779 30715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:48.414321 30715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:48.414474 30715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:48.414971 30715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:48.415795 30715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:48.415885 30715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.415935 30715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:48.415963 30715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.424115 30715 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:41959
I20260810 01:42:48.424173 30897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:41959 every 8 connection(s)
I20260810 01:42:48.424904 30715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:48.428850 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 30715
I20260810 01:42:48.428946 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:48.429231 16617 external_mini_cluster.cc:1428] Setting key b5a26c17a9c9da31ce6aa02a83631d1e
I20260810 01:42:48.431146 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34369
--builtin_ntp_servers=127.16.58.84:32919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 01:42:48.433853 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:48.426554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:40537 (local address 127.16.58.126:34369)
0810 01:42:48.426688 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:48.426692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:48.427635 (+ 943us) server_negotiation.cc:407] Connection header received
0810 01:42:48.429031 (+ 1396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:48.429035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:48.429095 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:48.429173 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:48.430167 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.430826 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.432058 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.432290 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.432379 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:48.433448 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:48.433452 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:48.433454 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:48.433466 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:48.433487 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:48.433495 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:48.433555 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:48.433696 (+ 141us) server_negotiation.cc:299] Negotiation successful
0810 01:42:48.433745 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:42:48.434738 30904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:48.426894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34369 (local address 127.16.58.65:40537)
0810 01:42:48.427501 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:48.427537 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:48.428824 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:48.429358 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:48.429366 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:48.429452 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:48.430022 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:48.430041 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.430945 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.430948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:48.431945 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:48.431956 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.432429 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.432433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:48.432591 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:48.433163 (+ 572us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:48.433165 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:48.433219 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:48.433295 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:48.433565 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:48.433573 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:48.433578 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:42:48.433697 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 01:42:48.433966 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":115,"threads_started":1}
I20260810 01:42:48.435830 30900 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34369
I20260810 01:42:48.436038 30900 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:48.436499 30900 heartbeater.cc:511] Master 127.16.58.126:34369 requested a full tablet report, sending...
I20260810 01:42:48.437929 30633 ts_manager.cc:194] Registered new tserver with Master: 371f863e004047bdac8d9af79aaadf41 (127.16.58.65:41959)
I20260810 01:42:48.439013 30633 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.65:40537
W20260810 01:42:48.541335 30906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:48.541585 30906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:48.541635 30906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:48.545554 30906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:48.545603 30906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:48.545674 30906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:48.550285 30906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:48.551251 30906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:48.552721 30906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:48.562674 30921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:48.562713 30918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:48.562852 30906 server_base.cc:1034] running on GCE node
W20260810 01:42:48.563553 30914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:48.563958 30906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:48.564540 30906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:48.565699 30906 hybrid_clock.cc:648] HybridClock initialized: now 1786326168565686 us; error 28 us; skew 500 ppm
I20260810 01:42:48.567348 30906 webserver.cc:460] Webserver started at http://127.16.58.66:33795/ using document root <none> and password file <none>
I20260810 01:42:48.567909 30906 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:48.567981 30906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:48.568185 30906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:48.570108 30906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "4bcee1ed905a414c811f7a89fa1478b9"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "4d2373a75957eb56649c6fc15b7950c5"
server_key_iv: "eed3e96f9e22a8506cf2e0473d888e45"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.570622 30906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "4bcee1ed905a414c811f7a89fa1478b9"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "4d2373a75957eb56649c6fc15b7950c5"
server_key_iv: "eed3e96f9e22a8506cf2e0473d888e45"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.574030 30906 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260810 01:42:48.576349 30934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.577422 30906 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:48.577525 30906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "4bcee1ed905a414c811f7a89fa1478b9"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "4d2373a75957eb56649c6fc15b7950c5"
server_key_iv: "eed3e96f9e22a8506cf2e0473d888e45"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.577617 30906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:48.594596 30906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:48.595204 30906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:48.595360 30906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:48.595937 30906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:48.596822 30906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:48.596870 30906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.596922 30906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:48.596947 30906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.605086 30906 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:44409
I20260810 01:42:48.605109 31109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:44409 every 8 connection(s)
I20260810 01:42:48.605896 30906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:48.608214 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 30906
I20260810 01:42:48.608320 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:48.608597 16617 external_mini_cluster.cc:1428] Setting key 6709598d737dc17c4eb645eb71537aef
I20260810 01:42:48.610608 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34369
--builtin_ntp_servers=127.16.58.84:32919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 01:42:48.615335 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:48.607550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:41163 (local address 127.16.58.126:34369)
0810 01:42:48.607686 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:48.607690 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:48.608804 (+ 1114us) server_negotiation.cc:407] Connection header received
0810 01:42:48.610337 (+ 1533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:48.610340 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:48.610392 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:48.610479 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:48.611334 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.612077 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.613610 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.613823 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.613900 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:48.614882 (+ 982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:48.614885 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:48.614887 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:48.614898 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:48.614917 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:48.614925 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:48.614981 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:48.615133 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 01:42:48.615195 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:42:48.616115 31112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:48.607943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34369 (local address 127.16.58.66:41163)
0810 01:42:48.608651 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:48.608702 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:48.610145 (+ 1443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:48.610613 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:48.610619 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:48.610709 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:48.611197 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:48.611210 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.612183 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.612186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:48.613482 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:48.613494 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.613953 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.613956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:48.614099 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:48.614637 (+ 538us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:48.614638 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:48.614676 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:48.614736 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:48.614993 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:48.615003 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:48.615009 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:42:48.615109 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 01:42:48.615373 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":111,"threads_started":1}
I20260810 01:42:48.617115 31110 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34369
I20260810 01:42:48.617331 31110 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:48.617785 31110 heartbeater.cc:511] Master 127.16.58.126:34369 requested a full tablet report, sending...
I20260810 01:42:48.618773 30633 ts_manager.cc:194] Registered new tserver with Master: 4bcee1ed905a414c811f7a89fa1478b9 (127.16.58.66:44409)
I20260810 01:42:48.619506 30633 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.66:41163
W20260810 01:42:48.720430 31113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:48.720762 31113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:48.720886 31113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:48.725297 31113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:48.725350 31113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:48.725431 31113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:48.730238 31113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34369
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:48.731154 31113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:48.732460 31113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:48.741423 31121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:48.741460 31123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:48.741456 31119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:48.741581 31113 server_base.cc:1034] running on GCE node
I20260810 01:42:48.742102 31113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:48.742677 31113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:48.743851 31113 hybrid_clock.cc:648] HybridClock initialized: now 1786326168743828 us; error 40 us; skew 500 ppm
I20260810 01:42:48.745607 31113 webserver.cc:460] Webserver started at http://127.16.58.67:42399/ using document root <none> and password file <none>
I20260810 01:42:48.746141 31113 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:48.746207 31113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:48.746413 31113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:48.748374 31113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "cc43f2336a9f42ffbd5c55b6c06eb67e"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "684441fd407c474558f3467992f5b5a1"
server_key_iv: "9ca390021f16008a5f5099d713dcd444"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.748893 31113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "cc43f2336a9f42ffbd5c55b6c06eb67e"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "684441fd407c474558f3467992f5b5a1"
server_key_iv: "9ca390021f16008a5f5099d713dcd444"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.752292 31113 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:42:48.754602 31134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.755705 31113 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:48.755846 31113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "cc43f2336a9f42ffbd5c55b6c06eb67e"
format_stamp: "Formatted at 2026-08-10 01:42:48 on dist-test-slave-jlzn"
server_key: "684441fd407c474558f3467992f5b5a1"
server_key_iv: "9ca390021f16008a5f5099d713dcd444"
server_key_version: "encryptionkey@0"
I20260810 01:42:48.755945 31113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:48.765646 31113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:48.766206 31113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:48.766355 31113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:48.766862 31113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:48.767743 31113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:48.767789 31113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.767851 31113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:48.767880 31113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:48.776070 31113 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:44213
I20260810 01:42:48.776119 31312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:44213 every 8 connection(s)
I20260810 01:42:48.776890 31113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:48.777530 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 31113
I20260810 01:42:48.777642 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:48.777901 16617 external_mini_cluster.cc:1428] Setting key 426e6bd76a566d6f72d96c53b8df9f8b
I20260810 01:42:48.785312 30688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:48.778580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:34957 (local address 127.16.58.126:34369)
0810 01:42:48.778712 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:48.778716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:48.779850 (+ 1134us) server_negotiation.cc:407] Connection header received
0810 01:42:48.781295 (+ 1445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:48.781298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:48.781345 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:48.781419 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:48.782203 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.782717 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.783751 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.784014 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.784087 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:48.784959 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:48.784962 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:48.784964 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:48.784975 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:48.784995 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:48.785002 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:48.785054 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:48.785153 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 01:42:48.785203 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:48.786036 31315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:48.779042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34369 (local address 127.16.58.67:34957)
0810 01:42:48.779705 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:48.779743 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:48.781103 (+ 1360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:48.781572 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:48.781578 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:48.781659 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:48.782097 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:48.782109 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.782804 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.782806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:48.783662 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:48.783671 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:48.784126 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:48.784128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:48.784264 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:48.784739 (+ 475us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:48.784740 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:48.784777 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:48.784835 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:48.785059 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:48.785064 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:48.785067 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 01:42:48.785145 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:42:48.785342 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":128,"threads_started":1}
I20260810 01:42:48.786929 31313 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34369
I20260810 01:42:48.787127 31313 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:48.787561 31313 heartbeater.cc:511] Master 127.16.58.126:34369 requested a full tablet report, sending...
I20260810 01:42:48.788501 30633 ts_manager.cc:194] Registered new tserver with Master: cc43f2336a9f42ffbd5c55b6c06eb67e (127.16.58.67:44213)
I20260810 01:42:48.789032 30633 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.67:34957
I20260810 01:42:48.791473 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 01:42:48.794004 30688 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:48.793268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39966 (local address 127.16.58.126:34369)
0810 01:42:48.793410 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:48.793414 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:48.793546 (+ 132us) server_negotiation.cc:407] Connection header received
0810 01:42:48.793605 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:48.793607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:48.793644 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:48.793702 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:48.793891 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39966: BlockingRecv error: recv got EOF from 127.0.0.1:39966 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260810 01:42:48.794162 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 30715
I20260810 01:42:48.834434 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 30906
I20260810 01:42:48.842643 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 31113
I20260810 01:42:48.856978 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 30589
2026-08-10T01:42:48Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (859 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T01:42:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:48Z Disabled control of system clock
I20260810 01:42:48.889067 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:40057
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:40057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 01:42:48.995683 31327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:48.995967 31327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:48.996006 31327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:48.999818 31327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:48.999866 31327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:48.999879 31327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:48.999897 31327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:48.999910 31327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:49.004458 31327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:40057
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:40057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:49.005378 31327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:49.006624 31327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:49.014720 31334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:49.014673 31333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:49.014760 31327 server_base.cc:1034] running on GCE node
W20260810 01:42:49.014709 31337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:49.015432 31327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:49.016459 31327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:49.017629 31327 hybrid_clock.cc:648] HybridClock initialized: now 1786326169017597 us; error 36 us; skew 500 ppm
I20260810 01:42:49.019296 31327 webserver.cc:460] Webserver started at http://127.16.58.126:33965/ using document root <none> and password file <none>
I20260810 01:42:49.019858 31327 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:49.019932 31327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:49.020129 31327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:49.022123 31327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "c41a56da7ce544af8e80f3d995eaed05"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "a82260dfa5895a4ec5f776e227505255"
server_key_iv: "f58beafc5aeb34f545e8c48c572ffaea"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.022655 31327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "c41a56da7ce544af8e80f3d995eaed05"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "a82260dfa5895a4ec5f776e227505255"
server_key_iv: "f58beafc5aeb34f545e8c48c572ffaea"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.026089 31327 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:42:49.028292 31348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.029353 31327 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:42:49.029464 31327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "c41a56da7ce544af8e80f3d995eaed05"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "a82260dfa5895a4ec5f776e227505255"
server_key_iv: "f58beafc5aeb34f545e8c48c572ffaea"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.029553 31327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:49.033869 31327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:49.034412 31327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:49.034564 31327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:49.041049 31327 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:40057
I20260810 01:42:49.041101 31431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:40057 every 8 connection(s)
I20260810 01:42:49.042050 31327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:49.043605 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 31327
I20260810 01:42:49.043709 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:49.043985 16617 external_mini_cluster.cc:1428] Setting key 82084af58fa37064efdd5cc80d7a787f
I20260810 01:42:49.045298 31432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:49.049149 31435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:49.045324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42378 (local address 127.16.58.126:40057)
0810 01:42:49.045904 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:49.045919 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:49.045953 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:42:49.046584 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:49.046601 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:49.046931 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:49.047216 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:49.048026 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:49.048030 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:49.048042 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:49.048052 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:49.048106 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:49.048122 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:49.048245 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:49.048322 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 01:42:49.048535 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":112,"threads_started":1}
I20260810 01:42:49.050911 31432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05: Bootstrap starting.
I20260810 01:42:49.052943 31432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:49.053678 31432 log.cc:824] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:49.055333 31432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05: No bootstrap required, opened a new log
I20260810 01:42:49.058552 31432 raft_consensus.cc:348] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c41a56da7ce544af8e80f3d995eaed05" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40057 } }
I20260810 01:42:49.058748 31432 raft_consensus.cc:374] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:49.058804 31432 raft_consensus.cc:729] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41a56da7ce544af8e80f3d995eaed05, State: Initialized, Role: FOLLOWER
I20260810 01:42:49.059199 31432 consensus_queue.cc:260] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c41a56da7ce544af8e80f3d995eaed05" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40057 } }
I20260810 01:42:49.059329 31432 raft_consensus.cc:388] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:49.059396 31432 raft_consensus.cc:482] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:49.059494 31432 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:49.060335 31432 raft_consensus.cc:504] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c41a56da7ce544af8e80f3d995eaed05" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40057 } }
I20260810 01:42:49.060639 31432 leader_election.cc:302] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c41a56da7ce544af8e80f3d995eaed05; no voters:
I20260810 01:42:49.060899 31432 leader_election.cc:288] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:49.061004 31437 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:49.061247 31437 raft_consensus.cc:686] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [term 1 LEADER]: Becoming Leader. State: Replica: c41a56da7ce544af8e80f3d995eaed05, State: Running, Role: LEADER
I20260810 01:42:49.061545 31437 consensus_queue.cc:237] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c41a56da7ce544af8e80f3d995eaed05" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40057 } }
I20260810 01:42:49.061968 31432 sys_catalog.cc:564] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:49.063061 31439 sys_catalog.cc:455] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c41a56da7ce544af8e80f3d995eaed05. Latest consensus state: current_term: 1 leader_uuid: "c41a56da7ce544af8e80f3d995eaed05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c41a56da7ce544af8e80f3d995eaed05" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40057 } } }
I20260810 01:42:49.063205 31439 sys_catalog.cc:458] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:49.063063 31438 sys_catalog.cc:455] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c41a56da7ce544af8e80f3d995eaed05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c41a56da7ce544af8e80f3d995eaed05" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40057 } } }
I20260810 01:42:49.063285 31438 sys_catalog.cc:458] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05 [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:49.063629 31448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:49.066200 31448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:49.071430 31448 catalog_manager.cc:1347] Generated new cluster ID: 62d0aff9ff4c4edaac54d56859ae9df6
I20260810 01:42:49.071497 31448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:49.082701 31448 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:49.083024 31448 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:49.093225 31448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c41a56da7ce544af8e80f3d995eaed05: Generated new TSK 0
I20260810 01:42:49.093902 31448 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:42:49.098609 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40057
--builtin_ntp_servers=127.16.58.84:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 01:42:49.207739 31464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:49.207988 31464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:49.208025 31464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:49.212037 31464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:49.212085 31464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:49.212142 31464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:49.216732 31464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:49.217607 31464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:49.218812 31464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:49.227635 31471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:49.227645 31473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:49.227636 31470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:49.227938 31464 server_base.cc:1034] running on GCE node
I20260810 01:42:49.228295 31464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:49.228837 31464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:49.229986 31464 hybrid_clock.cc:648] HybridClock initialized: now 1786326169229963 us; error 33 us; skew 500 ppm
I20260810 01:42:49.235013 31464 webserver.cc:460] Webserver started at http://127.16.58.65:44781/ using document root <none> and password file <none>
I20260810 01:42:49.235544 31464 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:49.235611 31464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:49.235797 31464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:49.237746 31464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "76069a3adde542dca1d7a81c4c65bffc"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "9dddb4e438a002d81216daa3cb25e7d9"
server_key_iv: "ab5adaa7174d8ebb83b9df1d10c9dada"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.238284 31464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "76069a3adde542dca1d7a81c4c65bffc"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "9dddb4e438a002d81216daa3cb25e7d9"
server_key_iv: "ab5adaa7174d8ebb83b9df1d10c9dada"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.241793 31464 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:42:49.244066 31484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.245153 31464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:49.245258 31464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "76069a3adde542dca1d7a81c4c65bffc"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "9dddb4e438a002d81216daa3cb25e7d9"
server_key_iv: "ab5adaa7174d8ebb83b9df1d10c9dada"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.245348 31464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:49.249578 31464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:49.250121 31464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:49.250278 31464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:49.250765 31464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:49.251632 31464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:49.251680 31464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.251729 31464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:49.251755 31464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.259939 31464 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:37667
I20260810 01:42:49.259990 31650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:37667 every 8 connection(s)
I20260810 01:42:49.260752 31464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:49.264981 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 31464
I20260810 01:42:49.265084 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:49.265357 16617 external_mini_cluster.cc:1428] Setting key b7f79ece128a28f2383cf089e10fcdf3
I20260810 01:42:49.266415 31435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:49.262387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:42879 (local address 127.16.58.126:40057)
0810 01:42:49.262527 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:49.262532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:49.263580 (+ 1048us) server_negotiation.cc:407] Connection header received
0810 01:42:49.264901 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:49.264904 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:49.264950 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:49.265027 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:49.266033 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:49.266036 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:49.266038 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:49.266048 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:49.266068 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:49.266076 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:49.266146 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:49.266276 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 01:42:49.266310 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:42:49.267189 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:49.262773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40057 (local address 127.16.58.65:42879)
0810 01:42:49.263457 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:49.263495 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:49.264683 (+ 1188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:49.265205 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:49.265212 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:49.265294 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:49.265810 (+ 516us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:49.265812 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:49.265850 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:49.265915 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:49.266150 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:49.266158 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:49.266163 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:42:49.266321 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 01:42:49.266543 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":111,"threads_started":1}
I20260810 01:42:49.267359 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40057
--builtin_ntp_servers=127.16.58.84:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 01:42:49.268524 31651 heartbeater.cc:347] Connected to a master server at 127.16.58.126:40057
I20260810 01:42:49.268735 31651 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:49.269129 31651 heartbeater.cc:511] Master 127.16.58.126:40057 requested a full tablet report, sending...
I20260810 01:42:49.270453 31376 ts_manager.cc:194] Registered new tserver with Master: 76069a3adde542dca1d7a81c4c65bffc (127.16.58.65:37667)
W20260810 01:42:49.385742 31656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:49.385963 31656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:49.386001 31656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:49.389891 31656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:49.389937 31656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:49.390003 31656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:49.394548 31656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:49.395416 31656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:49.396674 31656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:42:49.405520 31656 server_base.cc:1034] running on GCE node
W20260810 01:42:49.405495 31668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:49.405511 31664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:49.405728 31665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:49.406081 31656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:49.406647 31656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:49.407821 31656 hybrid_clock.cc:648] HybridClock initialized: now 1786326169407786 us; error 27 us; skew 500 ppm
I20260810 01:42:49.409435 31656 webserver.cc:460] Webserver started at http://127.16.58.66:42777/ using document root <none> and password file <none>
I20260810 01:42:49.409934 31656 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:49.410000 31656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:49.410202 31656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:49.412223 31656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "8c41ad281b3d4a269b4ae4350fab2a80"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "7ec8bce5c950f406501ee6fef8d87e42"
server_key_iv: "6884c0dcd6a98a9538c8eb4762707f35"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.412758 31656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "8c41ad281b3d4a269b4ae4350fab2a80"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "7ec8bce5c950f406501ee6fef8d87e42"
server_key_iv: "6884c0dcd6a98a9538c8eb4762707f35"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.416134 31656 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:42:49.418324 31675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.419364 31656 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:49.419479 31656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "8c41ad281b3d4a269b4ae4350fab2a80"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "7ec8bce5c950f406501ee6fef8d87e42"
server_key_iv: "6884c0dcd6a98a9538c8eb4762707f35"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.419571 31656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:49.423686 31656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:49.424261 31656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:49.424410 31656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:49.424906 31656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:49.425726 31656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:49.425773 31656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.425822 31656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:49.425850 31656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.433844 31656 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:37683
I20260810 01:42:49.433867 31857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:37683 every 8 connection(s)
I20260810 01:42:49.434644 31656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:49.440004 31435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:49.436244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:55929 (local address 127.16.58.126:40057)
0810 01:42:49.436383 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:49.436387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:49.437358 (+ 971us) server_negotiation.cc:407] Connection header received
0810 01:42:49.438530 (+ 1172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:49.438533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:49.438569 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:49.438646 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:49.439604 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:49.439607 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:49.439609 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:49.439620 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:49.439650 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:49.439659 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:49.439730 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:49.439861 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 01:42:49.439900 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:49.440778 31860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:49.436631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40057 (local address 127.16.58.66:55929)
0810 01:42:49.437227 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:49.437264 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:49.438361 (+ 1097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:49.438777 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:49.438782 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:49.438863 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:49.439368 (+ 505us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:49.439369 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:49.439405 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:49.439469 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:49.439723 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:49.439727 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:49.439731 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:42:49.439895 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 01:42:49.440081 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":109,"threads_started":1}
I20260810 01:42:49.441784 31858 heartbeater.cc:347] Connected to a master server at 127.16.58.126:40057
I20260810 01:42:49.441987 31858 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:49.442350 31858 heartbeater.cc:511] Master 127.16.58.126:40057 requested a full tablet report, sending...
I20260810 01:42:49.443305 31376 ts_manager.cc:194] Registered new tserver with Master: 8c41ad281b3d4a269b4ae4350fab2a80 (127.16.58.66:37683)
I20260810 01:42:49.443701 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 31656
I20260810 01:42:49.443845 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:49.444103 16617 external_mini_cluster.cc:1428] Setting key 54e296cfe37ade2c7a34ccd4d2f25468
I20260810 01:42:49.445749 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40057
--builtin_ntp_servers=127.16.58.84:43857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 01:42:49.552521 31861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:49.552754 31861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:49.552809 31861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:49.556648 31861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:49.556691 31861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:49.556761 31861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:49.562443 31861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:49.563431 31861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:49.564795 31861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:49.573875 31869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:49.573894 31879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:49.573880 31871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:49.574190 31861 server_base.cc:1034] running on GCE node
I20260810 01:42:49.574534 31861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:49.575103 31861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:49.576263 31861 hybrid_clock.cc:648] HybridClock initialized: now 1786326169576247 us; error 27 us; skew 500 ppm
I20260810 01:42:49.577883 31861 webserver.cc:460] Webserver started at http://127.16.58.67:40525/ using document root <none> and password file <none>
I20260810 01:42:49.578397 31861 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:49.578462 31861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:49.578640 31861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:49.580598 31861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "21471fd76fa94404b7dc1c2703ca1a2d"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "baf0628f4d9bfb2b6e261dc80d7a550a"
server_key_iv: "15e944647478a267b73b0c3a3361f839"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.581106 31861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "21471fd76fa94404b7dc1c2703ca1a2d"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "baf0628f4d9bfb2b6e261dc80d7a550a"
server_key_iv: "15e944647478a267b73b0c3a3361f839"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.584416 31861 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:42:49.586648 31886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.587705 31861 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:42:49.587836 31861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "21471fd76fa94404b7dc1c2703ca1a2d"
format_stamp: "Formatted at 2026-08-10 01:42:49 on dist-test-slave-jlzn"
server_key: "baf0628f4d9bfb2b6e261dc80d7a550a"
server_key_iv: "15e944647478a267b73b0c3a3361f839"
server_key_version: "encryptionkey@0"
I20260810 01:42:49.587929 31861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:49.592098 31861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:49.592648 31861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:49.592820 31861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:49.593315 31861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:49.594156 31861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:49.594201 31861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.594236 31861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:49.594255 31861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:49.602334 31861 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:33421
I20260810 01:42:49.602363 32059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:33421 every 8 connection(s)
I20260810 01:42:49.603137 31861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:42:49.608414 31435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:49.604752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:50243 (local address 127.16.58.126:40057)
0810 01:42:49.604876 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:49.604880 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:49.605815 (+ 935us) server_negotiation.cc:407] Connection header received
0810 01:42:49.606989 (+ 1174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:49.606992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:49.607034 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:49.607106 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:49.608086 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:49.608089 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:49.608091 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:42:49.608100 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:49.608117 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:42:49.608124 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:49.608185 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:49.608273 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 01:42:49.608307 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:42:49.609148 32065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:49.605086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40057 (local address 127.16.58.67:50243)
0810 01:42:49.605679 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:49.605716 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:49.606823 (+ 1107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:49.607242 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:49.607248 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:49.607326 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:49.607860 (+ 534us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:42:49.607862 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:49.607901 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:42:49.607965 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:49.608180 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:49.608185 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:49.608188 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 01:42:49.608303 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 01:42:49.608480 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":123,"threads_started":1}
I20260810 01:42:49.610188 32061 heartbeater.cc:347] Connected to a master server at 127.16.58.126:40057
I20260810 01:42:49.610379 32061 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:49.610723 32061 heartbeater.cc:511] Master 127.16.58.126:40057 requested a full tablet report, sending...
I20260810 01:42:49.611680 31376 ts_manager.cc:194] Registered new tserver with Master: 21471fd76fa94404b7dc1c2703ca1a2d (127.16.58.67:33421)
I20260810 01:42:49.611711 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 31861
I20260810 01:42:49.611796 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:49.612106 16617 external_mini_cluster.cc:1428] Setting key 90da48a567b1d101440c37e227507f20
I20260810 01:42:49.613903 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 01:42:49.616518 31435 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:42:49.615656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42384 (local address 127.16.58.126:40057)
0810 01:42:49.615771 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:49.615775 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:49.615994 (+ 219us) server_negotiation.cc:407] Connection header received
0810 01:42:49.616096 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:49.616099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:49.616130 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:49.616191 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:49.616413 (+ 222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42384: BlockingRecv error: recv got EOF from 127.0.0.1:42384 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:42:49.616657 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 31464
I20260810 01:42:49.647377 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 31656
I20260810 01:42:49.656060 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 31861
I20260810 01:42:49.661790 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 31327
2026-08-10T01:42:49Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (807 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:49 dist-test-slave-jlzn krb5kdc[32082](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:49 dist-test-slave-jlzn krb5kdc[32082](info): set up 2 sockets
Aug 10 01:42:49 dist-test-slave-jlzn krb5kdc[32082](info): commencing operation
krb5kdc: starting...
W20260810 01:42:50.782675 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:50 dist-test-slave-jlzn krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:42:50.903692 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38897
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:40837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:38897
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:51.010243 32098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:51.010495 32098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:51.010547 32098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:51.014453 32098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:42:51.014510 32098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:51.014537 32098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:51.014556 32098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:42:51.014576 32098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:42:51.019582 32098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:40837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:38897
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:51.020531 32098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:51.021461 32098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:51.029363 32107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:51.029417 32105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:51.029430 32104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:51.029701 32098 server_base.cc:1034] running on GCE node
I20260810 01:42:51.030238 32098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:51.031219 32098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:51.032359 32098 hybrid_clock.cc:648] HybridClock initialized: now 1786326171032335 us; error 38 us; skew 500 ppm
Aug 10 01:42:51 dist-test-slave-jlzn krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326171, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:51.034915 32098 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:42:51.035727 32098 webserver.cc:460] Webserver started at http://127.16.58.126:41495/ using document root <none> and password file <none>
I20260810 01:42:51.036253 32098 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:51.036319 32098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:51.036496 32098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:51.038389 32098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "340412629f4148df9d3e39e18de7067e"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "0599e90a9679a1dfb9ce3bb3d0a25d9e"
server_key_iv: "a85be1ac82ee3bcdd5d6ab72594b7a7d"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.038908 32098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "340412629f4148df9d3e39e18de7067e"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "0599e90a9679a1dfb9ce3bb3d0a25d9e"
server_key_iv: "a85be1ac82ee3bcdd5d6ab72594b7a7d"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.042268 32098 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 01:42:51.044485 32118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.045537 32098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:51.045660 32098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "340412629f4148df9d3e39e18de7067e"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "0599e90a9679a1dfb9ce3bb3d0a25d9e"
server_key_iv: "a85be1ac82ee3bcdd5d6ab72594b7a7d"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.045747 32098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:51.066248 32098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:51.069033 32098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:51.069205 32098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:51.075762 32098 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:38897
I20260810 01:42:51.076032 32196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:38897 every 8 connection(s)
I20260810 01:42:51.076649 32098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:42:51.078718 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 32098
I20260810 01:42:51.078835 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:42:51.079131 16617 external_mini_cluster.cc:1428] Setting key 2fb3c320bc538bf593e41199fa8877b4
I20260810 01:42:51.079437 32198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:51.086262 32198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e: Bootstrap starting.
Aug 10 01:42:51 dist-test-slave-jlzn krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326170, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:51.088687 32198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:51.089373 32198 log.cc:824] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:51.091331 32198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e: No bootstrap required, opened a new log
I20260810 01:42:51.092983 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.080461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51454 (local address 127.16.58.126:38897)
0810 01:42:51.080858 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:51.080877 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:51.080917 (+ 40us) server_negotiation.cc:407] Connection header received
0810 01:42:51.081634 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:51.081658 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:51.082049 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:51.082392 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:51.083018 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.084486 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.085279 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.085948 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.086102 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.088552 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:51.088557 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:51.088569 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:51.088594 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:51.090261 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.090708 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.090712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.090716 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.090815 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.091074 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.091076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.091077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.091433 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:51.091661 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:51.091905 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 01:42:51.092170 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":113,"threads_started":1}
I20260810 01:42:51.094236 32198 raft_consensus.cc:348] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340412629f4148df9d3e39e18de7067e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38897 } }
I20260810 01:42:51.094442 32198 raft_consensus.cc:374] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:51.094501 32198 raft_consensus.cc:729] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340412629f4148df9d3e39e18de7067e, State: Initialized, Role: FOLLOWER
I20260810 01:42:51.094915 32198 consensus_queue.cc:260] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340412629f4148df9d3e39e18de7067e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38897 } }
I20260810 01:42:51.095077 32198 raft_consensus.cc:388] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:42:51.095151 32198 raft_consensus.cc:482] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:42:51.095247 32198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:51.096082 32198 raft_consensus.cc:504] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340412629f4148df9d3e39e18de7067e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38897 } }
I20260810 01:42:51.096387 32198 leader_election.cc:302] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 340412629f4148df9d3e39e18de7067e; no voters:
I20260810 01:42:51.096644 32198 leader_election.cc:288] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:42:51.096727 32208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:51.096931 32208 raft_consensus.cc:686] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [term 1 LEADER]: Becoming Leader. State: Replica: 340412629f4148df9d3e39e18de7067e, State: Running, Role: LEADER
I20260810 01:42:51.097273 32208 consensus_queue.cc:237] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340412629f4148df9d3e39e18de7067e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38897 } }
I20260810 01:42:51.097735 32198 sys_catalog.cc:564] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:42:51.098733 32211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 340412629f4148df9d3e39e18de7067e. Latest consensus state: current_term: 1 leader_uuid: "340412629f4148df9d3e39e18de7067e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340412629f4148df9d3e39e18de7067e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38897 } } }
I20260810 01:42:51.098862 32211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:51.098767 32210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "340412629f4148df9d3e39e18de7067e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340412629f4148df9d3e39e18de7067e" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38897 } } }
I20260810 01:42:51.098987 32210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e [sys.catalog]: This master's current role is: LEADER
I20260810 01:42:51.099268 32222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:42:51.102273 32222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:42:51.107661 32222 catalog_manager.cc:1347] Generated new cluster ID: 1104ae13df7744d5929f950ab750e335
I20260810 01:42:51.107719 32222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:42:51.127121 32222 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:42:51.128029 32222 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:42:51.136233 32222 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e: Generated new TSK 0
I20260810 01:42:51.136821 32222 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:42:51.172070 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38897
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:40837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:51.308845 32239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:51.309072 32239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:51.309113 32239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:51.312992 32239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:51.313040 32239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:51.313108 32239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:42:51.318065 32239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:40837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:51.318997 32239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:51.319985 32239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:51.329077 32248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:51.329105 32246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:51.329100 32245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:51.329325 32239 server_base.cc:1034] running on GCE node
I20260810 01:42:51.329775 32239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:51.330360 32239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:51.331527 32239 hybrid_clock.cc:648] HybridClock initialized: now 1786326171331512 us; error 24 us; skew 500 ppm
Aug 10 01:42:51 dist-test-slave-jlzn krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326171, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:51.334107 32239 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:42:51.334882 32239 webserver.cc:460] Webserver started at http://127.16.58.65:44797/ using document root <none> and password file <none>
I20260810 01:42:51.335388 32239 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:51.335448 32239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:51.335642 32239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:51.337581 32239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "5a6d56674b1e4f0abf9ac5bb38767ead"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "c5f4c2a32d80392427ee9130e4243019"
server_key_iv: "25287c75779a356b7dc1e1ae83d83d50"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.338115 32239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "5a6d56674b1e4f0abf9ac5bb38767ead"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "c5f4c2a32d80392427ee9130e4243019"
server_key_iv: "25287c75779a356b7dc1e1ae83d83d50"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.341748 32239 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:42:51.344039 32259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.345172 32239 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:42:51.345283 32239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "5a6d56674b1e4f0abf9ac5bb38767ead"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "c5f4c2a32d80392427ee9130e4243019"
server_key_iv: "25287c75779a356b7dc1e1ae83d83d50"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.345376 32239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:51.374044 32239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:51.376806 32239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:51.376981 32239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:51.377583 32239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:51.378414 32239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:51.378461 32239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.378506 32239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:51.378543 32239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.386749 32239 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:35371
I20260810 01:42:51.386780 32441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:35371 every 8 connection(s)
I20260810 01:42:51.387605 32239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:42:51.388334 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 32239
I20260810 01:42:51.388423 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:42:51.388695 16617 external_mini_cluster.cc:1428] Setting key efdee88907aa130e0dc4bb1ace0e1a33
Aug 10 01:42:51 dist-test-slave-jlzn krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326171, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:42:51.402179 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.389404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:41101 (local address 127.16.58.126:38897)
0810 01:42:51.389535 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:51.389540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:51.390457 (+ 917us) server_negotiation.cc:407] Connection header received
0810 01:42:51.392190 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:51.392192 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:51.392237 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:51.392303 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:51.393423 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.394062 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.395700 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.395967 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.396044 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.398760 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:51.398763 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:51.398765 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:51.398790 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:51.400331 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.400774 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.400776 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.400778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.400902 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.401215 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.401217 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.401218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.401396 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:51.401471 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:51.401915 (+ 444us) server_negotiation.cc:299] Negotiation successful
0810 01:42:51.402041 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
I20260810 01:42:51.403040 32444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.389816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38897 (local address 127.16.58.65:41101)
0810 01:42:51.390298 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:51.390354 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:51.391983 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:51.392464 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:51.392470 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:51.392813 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:51.393276 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.393290 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.394229 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.394233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.395577 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.395590 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.396120 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.396134 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.396332 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.396897 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:51.396917 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:51.398603 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:51.400429 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:51.400433 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:51.400444 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:51.400696 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:51.400979 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:51.400982 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:51.400984 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:51.401132 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:51.401472 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:51.401476 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:51.401701 (+ 225us) client_negotiation.cc:769] Sending connection context
0810 01:42:51.401851 (+ 150us) client_negotiation.cc:240] Negotiation successful
0810 01:42:51.402123 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":141,"threads_started":1}
I20260810 01:42:51.404285 32442 heartbeater.cc:347] Connected to a master server at 127.16.58.126:38897
I20260810 01:42:51.404495 32442 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:51.404939 32442 heartbeater.cc:511] Master 127.16.58.126:38897 requested a full tablet report, sending...
I20260810 01:42:51.406540 32142 ts_manager.cc:194] Registered new tserver with Master: 5a6d56674b1e4f0abf9ac5bb38767ead (127.16.58.65:35371)
I20260810 01:42:51.408111 32142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:41101
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:42:51.416023 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38897
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:40837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:51.521836 32448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:51.522084 32448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:51.522143 32448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:51.526053 32448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:51.526106 32448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:51.526183 32448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:42:51.531214 32448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:40837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:51.532188 32448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:51.533134 32448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:51.542182 32459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:51.542194 32463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:51.542187 32456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:51.542403 32448 server_base.cc:1034] running on GCE node
I20260810 01:42:51.542834 32448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:51.543392 32448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:51.544576 32448 hybrid_clock.cc:648] HybridClock initialized: now 1786326171544553 us; error 39 us; skew 500 ppm
Aug 10 01:42:51 dist-test-slave-jlzn krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326171, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:51.547207 32448 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:42:51.548058 32448 webserver.cc:460] Webserver started at http://127.16.58.66:38787/ using document root <none> and password file <none>
I20260810 01:42:51.548599 32448 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:51.548659 32448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:51.548903 32448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:51.550916 32448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "9694e353c6014cf599ed1bb3dbab49d4"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "775fd9a2d1cb58fd517de0123850db0f"
server_key_iv: "d8ed1c0f91921c140344547017be68f0"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.551455 32448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "9694e353c6014cf599ed1bb3dbab49d4"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "775fd9a2d1cb58fd517de0123850db0f"
server_key_iv: "d8ed1c0f91921c140344547017be68f0"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.554909 32448 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:42:51.557166 32472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.558259 32448 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:51.558359 32448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "9694e353c6014cf599ed1bb3dbab49d4"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "775fd9a2d1cb58fd517de0123850db0f"
server_key_iv: "d8ed1c0f91921c140344547017be68f0"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.558454 32448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:51.571784 32448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:51.574661 32448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:51.574817 32448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:51.575330 32448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:51.576134 32448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:51.576186 32448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.576228 32448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:51.576257 32448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.584215 32448 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:45191
I20260810 01:42:51.584263 32646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:45191 every 8 connection(s)
I20260810 01:42:51.585009 32448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:42:51.591038 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 32448
I20260810 01:42:51.591133 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:42:51.591399 16617 external_mini_cluster.cc:1428] Setting key 5d75f388fbe172d77b57ca38127af125
Aug 10 01:42:51 dist-test-slave-jlzn krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326171, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:51.597886 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.586579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:52781 (local address 127.16.58.126:38897)
0810 01:42:51.586712 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:51.586716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:51.587493 (+ 777us) server_negotiation.cc:407] Connection header received
0810 01:42:51.588913 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:51.588916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:51.588965 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:51.589049 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:51.590094 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.590642 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.591906 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.592156 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.592254 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.594584 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:51.594588 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:51.594591 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:51.594619 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:51.595890 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.596367 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.596371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.596372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.596468 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.596778 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.596781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.596783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.596993 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:51.597088 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:51.597589 (+ 501us) server_negotiation.cc:299] Negotiation successful
0810 01:42:51.597723 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:42:51.598636 32649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.586933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38897 (local address 127.16.58.66:52781)
0810 01:42:51.587353 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:51.587394 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:51.588709 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:51.589187 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:51.589192 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:51.589545 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:51.589976 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.589990 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.590758 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.590761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.591752 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.591765 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.592334 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.592338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.592506 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.593039 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:51.593056 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:51.594411 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:51.595990 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:51.595997 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:51.596009 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:51.596261 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:51.596559 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:51.596561 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:51.596563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:51.596696 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:51.597119 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:51.597124 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:51.597337 (+ 213us) client_negotiation.cc:769] Sending connection context
0810 01:42:51.597511 (+ 174us) client_negotiation.cc:240] Negotiation successful
0810 01:42:51.597834 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":112,"threads_started":1}
I20260810 01:42:51.599886 32647 heartbeater.cc:347] Connected to a master server at 127.16.58.126:38897
I20260810 01:42:51.600101 32647 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:51.600529 32647 heartbeater.cc:511] Master 127.16.58.126:38897 requested a full tablet report, sending...
I20260810 01:42:51.601577 32142 ts_manager.cc:194] Registered new tserver with Master: 9694e353c6014cf599ed1bb3dbab49d4 (127.16.58.66:45191)
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:42:51.602310 32142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:52781
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:42:51.618101 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38897
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:40837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:42:51.723698 32652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:42:51.723934 32652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:42:51.723974 32652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:42:51.727742 32652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:42:51.727787 32652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:42:51.727891 32652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:42:51.732784 32652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:40837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38897
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:42:51.733600 32652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:42:51.734432 32652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:42:51.743440 32662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:42:51.743448 32657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:51.743721 32652 server_base.cc:1034] running on GCE node
W20260810 01:42:51.743444 32660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:42:51.744294 32652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:42:51.744854 32652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:42:51.746006 32652 hybrid_clock.cc:648] HybridClock initialized: now 1786326171745992 us; error 28 us; skew 500 ppm
Aug 10 01:42:51 dist-test-slave-jlzn krb5kdc[32082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326171, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:42:51.751263 32652 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:42:51.752077 32652 webserver.cc:460] Webserver started at http://127.16.58.67:46245/ using document root <none> and password file <none>
I20260810 01:42:51.752559 32652 fs_manager.cc:359] Metadata directory not provided
I20260810 01:42:51.752622 32652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:42:51.752840 32652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:42:51.754694 32652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "55797c32e0dd4e35a78ac0c188f90a7c"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "5521f03dbed7ee687b631cbdd4f7e4e5"
server_key_iv: "33c6cdb0845828ddedbda458ffdd8379"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.755219 32652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "55797c32e0dd4e35a78ac0c188f90a7c"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "5521f03dbed7ee687b631cbdd4f7e4e5"
server_key_iv: "33c6cdb0845828ddedbda458ffdd8379"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.758600 32652 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:42:51.760782 32673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.761909 32652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:42:51.762029 32652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "55797c32e0dd4e35a78ac0c188f90a7c"
format_stamp: "Formatted at 2026-08-10 01:42:51 on dist-test-slave-jlzn"
server_key: "5521f03dbed7ee687b631cbdd4f7e4e5"
server_key_iv: "33c6cdb0845828ddedbda458ffdd8379"
server_key_version: "encryptionkey@0"
I20260810 01:42:51.762112 32652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:42:51.791386 32652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:42:51.794032 32652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:42:51.794189 32652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:42:51.794678 32652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:42:51.795423 32652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:42:51.795469 32652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.795507 32652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:42:51.795527 32652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:42:51.803663 32652 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:40775
I20260810 01:42:51.803706 368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:40775 every 8 connection(s)
I20260810 01:42:51.804534 32652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
Aug 10 01:42:51 dist-test-slave-jlzn krb5kdc[32082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326171, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:42:51.813611 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 32652
I20260810 01:42:51.813721 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:42:51.814042 16617 external_mini_cluster.cc:1428] Setting key 7f0bda1794fdc44251493697feddcecf
I20260810 01:42:51.817006 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.806195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:44255 (local address 127.16.58.126:38897)
0810 01:42:51.806331 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:51.806335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:51.807084 (+ 749us) server_negotiation.cc:407] Connection header received
0810 01:42:51.808387 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:51.808390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:51.808438 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:51.808498 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:51.809533 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.810057 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.811110 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.811317 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.811381 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.813641 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:51.813644 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:51.813646 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:51.813670 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:51.815061 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.815528 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.815532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.815534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.815615 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.815968 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.815971 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.815973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.816163 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:51.816250 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:51.816723 (+ 473us) server_negotiation.cc:299] Negotiation successful
0810 01:42:51.816852 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:42:51.817705 372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.806516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38897 (local address 127.16.58.67:44255)
0810 01:42:51.806944 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:51.806983 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:51.808194 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:51.808645 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:51.808651 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:51.808979 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:42:51.809420 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.809434 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.810146 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.810148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.811020 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.811029 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.811415 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.811418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.811563 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.812121 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:42:51.812138 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:42:51.813486 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:42:51.815168 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:51.815174 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:51.815188 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:51.815433 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:51.815700 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:42:51.815704 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:42:51.815706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:42:51.815879 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:42:51.816261 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:42:51.816267 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:42:51.816492 (+ 225us) client_negotiation.cc:769] Sending connection context
0810 01:42:51.816650 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 01:42:51.816951 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":126,"threads_started":1}
I20260810 01:42:51.818646 369 heartbeater.cc:347] Connected to a master server at 127.16.58.126:38897
I20260810 01:42:51.818854 369 heartbeater.cc:464] Registering TS with master...
I20260810 01:42:51.819293 369 heartbeater.cc:511] Master 127.16.58.126:38897 requested a full tablet report, sending...
I20260810 01:42:51.820225 32142 ts_manager.cc:194] Registered new tserver with Master: 55797c32e0dd4e35a78ac0c188f90a7c (127.16.58.67:40775)
I20260810 01:42:51.820770 32142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:44255
I20260810 01:42:51.827466 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:42:51.836191 32206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.829295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53184 (local address 127.16.58.126:38897)
0810 01:42:51.829408 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:51.829412 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:51.829608 (+ 196us) server_negotiation.cc:407] Connection header received
0810 01:42:51.829728 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:51.829732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:51.829772 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:51.829829 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:42:51.830485 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.830999 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.831854 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.832074 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.832160 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.833373 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:42:51.833377 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:42:51.833380 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:42:51.833405 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:42:51.834646 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.835016 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.835019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.835021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.835095 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:42:51.835336 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:42:51.835339 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:42:51.835341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:42:51.835541 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:42:51.835670 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:51.835949 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 01:42:51.836054 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:42:51.838577 32142 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53184:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:42:51.841499 32142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:42:51.855561 390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.849423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:35371 (local address 127.0.0.1:55184)
0810 01:42:51.849893 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:51.849931 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:51.850032 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:51.851408 (+ 1376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:51.851411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:51.851437 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:51.851611 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.851619 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.853117 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.853120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.854268 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.854277 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.855031 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.855035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.855150 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.855188 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 01:42:51.855288 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 01:42:51.855401 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":81,"spinlock_wait_cycles":3200,"thread_start_us":81,"threads_started":1}
I20260810 01:42:51.855928 400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.850238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40660 (local address 127.16.58.67:40775)
0810 01:42:51.850573 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:51.850584 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:51.850690 (+ 106us) server_negotiation.cc:407] Connection header received
0810 01:42:51.850968 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:51.850974 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:51.851199 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:51.851394 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:51.851959 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.853038 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.854422 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.855189 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.855282 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.855403 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:51.855499 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 01:42:51.855582 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":119,"threads_started":1}
I20260810 01:42:51.855973 396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.849698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:40775 (local address 127.0.0.1:40660)
0810 01:42:51.850587 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:51.850601 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:51.850703 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:51.851392 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:51.851398 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:51.851431 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:51.851837 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.851844 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.853188 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.853191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.854290 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.854302 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.855286 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.855290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.855384 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.855406 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:42:51.855474 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 01:42:51.855544 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":821,"mutex_wait_us":20,"spinlock_wait_cycles":2304,"thread_start_us":97,"threads_started":1}
I20260810 01:42:51.856033 393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.849583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55184 (local address 127.16.58.65:35371)
0810 01:42:51.850924 (+ 1341us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:51.850942 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:51.850964 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:42:51.851045 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:51.851049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:51.851261 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:51.851542 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:51.851718 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.852955 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.854377 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.854914 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.855014 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.855165 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:51.855792 (+ 627us) server_negotiation.cc:299] Negotiation successful
0810 01:42:51.855902 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1246,"thread_start_us":104,"threads_started":1}
I20260810 01:42:51.855561 398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.850151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:45191 (local address 127.0.0.1:40552)
0810 01:42:51.850879 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:51.850892 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:51.850982 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:51.851639 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:51.851641 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:51.851658 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:51.851728 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.851733 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.852721 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.852724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.853975 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:51.853987 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.855241 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.855245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:51.855334 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.855354 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:42:51.855414 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 01:42:51.855467 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":95,"threads_started":1}
I20260810 01:42:51.856354 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:51.850346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40552 (local address 127.16.58.66:45191)
0810 01:42:51.850717 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:51.850729 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:51.851074 (+ 345us) server_negotiation.cc:407] Connection header received
0810 01:42:51.851151 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:51.851155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:51.851327 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:51.851451 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:51.851865 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.852598 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.854091 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:51.854930 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:51.855038 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:51.855179 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:51.855643 (+ 464us) server_negotiation.cc:299] Negotiation successful
0810 01:42:51.855864 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":153,"threads_started":1}
I20260810 01:42:51.858783 32344 tablet_service.cc:1467] Processing CreateTablet for tablet b492199937664780a3b59217897c8cc8 (DEFAULT_TABLE table=test-table [id=9c1cb58d05994bcf9c678ce542905fbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:51.858896 32742 tablet_service.cc:1467] Processing CreateTablet for tablet b492199937664780a3b59217897c8cc8 (DEFAULT_TABLE table=test-table [id=9c1cb58d05994bcf9c678ce542905fbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:51.858896 32546 tablet_service.cc:1467] Processing CreateTablet for tablet b492199937664780a3b59217897c8cc8 (DEFAULT_TABLE table=test-table [id=9c1cb58d05994bcf9c678ce542905fbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:42:51.859748 32344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b492199937664780a3b59217897c8cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:51.859918 32546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b492199937664780a3b59217897c8cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:51.859928 32742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b492199937664780a3b59217897c8cc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:42:51.866868 403 tablet_bootstrap.cc:492] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead: Bootstrap starting.
I20260810 01:42:51.867131 405 tablet_bootstrap.cc:492] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: Bootstrap starting.
I20260810 01:42:51.868141 404 tablet_bootstrap.cc:492] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: Bootstrap starting.
I20260810 01:42:51.868852 403 tablet_bootstrap.cc:654] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:51.869526 405 tablet_bootstrap.cc:654] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:51.869910 403 log.cc:824] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:51.870102 404 tablet_bootstrap.cc:654] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: Neither blocks nor log segments found. Creating new log.
I20260810 01:42:51.870340 405 log.cc:824] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:51.871241 404 log.cc:824] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: Log is configured to *not* fsync() on all Append() calls
I20260810 01:42:51.871874 403 tablet_bootstrap.cc:492] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead: No bootstrap required, opened a new log
I20260810 01:42:51.872071 403 ts_tablet_manager.cc:1397] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:42:51.872517 405 tablet_bootstrap.cc:492] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: No bootstrap required, opened a new log
I20260810 01:42:51.872704 405 ts_tablet_manager.cc:1397] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260810 01:42:51.873111 404 tablet_bootstrap.cc:492] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: No bootstrap required, opened a new log
I20260810 01:42:51.873284 404 ts_tablet_manager.cc:1397] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:42:51.875872 404 raft_consensus.cc:348] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } }
I20260810 01:42:51.875836 403 raft_consensus.cc:348] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } }
I20260810 01:42:51.876083 404 raft_consensus.cc:374] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:51.876083 403 raft_consensus.cc:374] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:51.876154 404 raft_consensus.cc:729] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55797c32e0dd4e35a78ac0c188f90a7c, State: Initialized, Role: FOLLOWER
I20260810 01:42:51.876163 403 raft_consensus.cc:729] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a6d56674b1e4f0abf9ac5bb38767ead, State: Initialized, Role: FOLLOWER
I20260810 01:42:51.876212 405 raft_consensus.cc:348] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } }
I20260810 01:42:51.876489 405 raft_consensus.cc:374] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:42:51.876545 405 raft_consensus.cc:729] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9694e353c6014cf599ed1bb3dbab49d4, State: Initialized, Role: FOLLOWER
I20260810 01:42:51.876579 403 consensus_queue.cc:260] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } }
I20260810 01:42:51.876580 404 consensus_queue.cc:260] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } }
I20260810 01:42:51.876958 405 consensus_queue.cc:260] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } }
I20260810 01:42:51.877285 32442 heartbeater.cc:503] Master 127.16.58.126:38897 was elected leader, sending a full tablet report...
I20260810 01:42:51.877540 403 ts_tablet_manager.cc:1428] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:42:51.877549 404 ts_tablet_manager.cc:1428] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260810 01:42:51.877849 369 heartbeater.cc:503] Master 127.16.58.126:38897 was elected leader, sending a full tablet report...
I20260810 01:42:51.878582 405 ts_tablet_manager.cc:1428] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:42:51.878916 32647 heartbeater.cc:503] Master 127.16.58.126:38897 was elected leader, sending a full tablet report...
W20260810 01:42:51.888710 32443 tablet.cc:2369] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:42:52.007382 412 raft_consensus.cc:482] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:42:52.007586 412 raft_consensus.cc:504] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } }
I20260810 01:42:52.008769 412 leader_election.cc:288] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5a6d56674b1e4f0abf9ac5bb38767ead (127.16.58.65:35371), 55797c32e0dd4e35a78ac0c188f90a7c (127.16.58.67:40775)
I20260810 01:42:52.012212 393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:52.009082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:53869 (local address 127.16.58.65:35371)
0810 01:42:52.009223 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:52.009228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:52.009244 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:42:52.009371 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:52.009373 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:52.009414 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:52.009477 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:52.009773 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.010267 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.011285 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.011680 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.011784 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:52.011867 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:52.012028 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 01:42:52.012095 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:42:52.012214 32649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:52.008965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:35371 (local address 127.16.58.66:53869)
0810 01:42:52.009151 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:52.009165 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:52.009256 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:52.009506 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:52.009509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:52.009556 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:52.009668 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:52.009673 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.010373 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.010377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:52.011164 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:52.011173 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.011788 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.011791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:52.011916 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:52.011937 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:42:52.012002 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 01:42:52.012070 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":1,"spinlock_wait_cycles":38400}
I20260810 01:42:52.012415 400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:52.009254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:56571 (local address 127.16.58.67:40775)
0810 01:42:52.009370 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:52.009374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:52.009514 (+ 140us) server_negotiation.cc:407] Connection header received
0810 01:42:52.009669 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:52.009671 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:52.009714 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:52.009774 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:42:52.010021 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.010495 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.011474 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.011912 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.012018 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:52.012070 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:52.012245 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 01:42:52.012313 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 01:42:52.012429 413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:52.009019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:40775 (local address 127.16.58.66:56571)
0810 01:42:52.009432 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:52.009443 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:42:52.009566 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:42:52.009794 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:42:52.009797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:42:52.009812 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:42:52.009922 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:52.009927 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.010598 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.010601 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:52.011357 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:42:52.011365 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.012018 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.012022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:42:52.012135 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:52.012154 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:42:52.012217 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 01:42:52.012283 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"spinlock_wait_cycles":6272,"thread_start_us":130,"threads_started":1}
I20260810 01:42:52.012892 32372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b492199937664780a3b59217897c8cc8" candidate_uuid: "9694e353c6014cf599ed1bb3dbab49d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" is_pre_election: true
I20260810 01:42:52.013026 305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b492199937664780a3b59217897c8cc8" candidate_uuid: "9694e353c6014cf599ed1bb3dbab49d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" is_pre_election: true
I20260810 01:42:52.013167 32372 raft_consensus.cc:2454] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9694e353c6014cf599ed1bb3dbab49d4 in term 0.
I20260810 01:42:52.013311 305 raft_consensus.cc:2454] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9694e353c6014cf599ed1bb3dbab49d4 in term 0.
I20260810 01:42:52.013603 32476 leader_election.cc:302] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a6d56674b1e4f0abf9ac5bb38767ead, 9694e353c6014cf599ed1bb3dbab49d4; no voters:
I20260810 01:42:52.013861 412 raft_consensus.cc:2781] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:42:52.013953 412 raft_consensus.cc:482] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:42:52.014003 412 raft_consensus.cc:3037] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:52.014997 412 raft_consensus.cc:504] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } }
I20260810 01:42:52.015307 412 leader_election.cc:288] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [CANDIDATE]: Term 1 election: Requested vote from peers 5a6d56674b1e4f0abf9ac5bb38767ead (127.16.58.65:35371), 55797c32e0dd4e35a78ac0c188f90a7c (127.16.58.67:40775)
I20260810 01:42:52.015625 32372 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b492199937664780a3b59217897c8cc8" candidate_uuid: "9694e353c6014cf599ed1bb3dbab49d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead"
I20260810 01:42:52.015628 305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b492199937664780a3b59217897c8cc8" candidate_uuid: "9694e353c6014cf599ed1bb3dbab49d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55797c32e0dd4e35a78ac0c188f90a7c"
I20260810 01:42:52.015748 305 raft_consensus.cc:3037] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:52.015748 32372 raft_consensus.cc:3037] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:42:52.016997 32372 raft_consensus.cc:2454] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9694e353c6014cf599ed1bb3dbab49d4 in term 1.
I20260810 01:42:52.016997 305 raft_consensus.cc:2454] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9694e353c6014cf599ed1bb3dbab49d4 in term 1.
I20260810 01:42:52.017283 32474 leader_election.cc:302] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 55797c32e0dd4e35a78ac0c188f90a7c, 5a6d56674b1e4f0abf9ac5bb38767ead, 9694e353c6014cf599ed1bb3dbab49d4; no voters:
I20260810 01:42:52.017473 412 raft_consensus.cc:2781] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:42:52.017694 412 raft_consensus.cc:686] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 1 LEADER]: Becoming Leader. State: Replica: 9694e353c6014cf599ed1bb3dbab49d4, State: Running, Role: LEADER
I20260810 01:42:52.018010 412 consensus_queue.cc:237] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } }
I20260810 01:42:52.020897 32142 catalog_manager.cc:5495] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9694e353c6014cf599ed1bb3dbab49d4 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "9694e353c6014cf599ed1bb3dbab49d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9694e353c6014cf599ed1bb3dbab49d4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 45191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 } health_report { overall_health: UNKNOWN } } }
I20260810 01:42:52.040555 401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:52.037646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40562 (local address 127.16.58.66:45191)
0810 01:42:52.037759 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:42:52.037762 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:42:52.037773 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:42:52.037895 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:42:52.037897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:42:52.037946 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:42:52.038025 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:42:52.038208 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.038662 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.039415 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:42:52.039604 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:42:52.039664 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:42:52.039890 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:42:52.040257 (+ 367us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:42:52.040343 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:42:52.040388 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 01:42:52.040433 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:42:52.045727 305 raft_consensus.cc:1261] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [term 1 FOLLOWER]: Refusing update from remote peer 9694e353c6014cf599ed1bb3dbab49d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:52.045751 32372 raft_consensus.cc:1261] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead [term 1 FOLLOWER]: Refusing update from remote peer 9694e353c6014cf599ed1bb3dbab49d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:42:52.046386 414 consensus_queue.cc:1035] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55797c32e0dd4e35a78ac0c188f90a7c" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:52.046543 412 consensus_queue.cc:1035] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a6d56674b1e4f0abf9ac5bb38767ead" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:42:52.053246 417 mvcc.cc:205] Tried to move back new op lower bound from 7316792000692867072 to 7316792000588009472. Current Snapshot: MvccSnapshot[applied={T|T < 7316792000692867072}]
I20260810 01:42:52.053531 419 mvcc.cc:205] Tried to move back new op lower bound from 7316792000692867072 to 7316792000588009472. Current Snapshot: MvccSnapshot[applied={T|T < 7316792000692867072}]
I20260810 01:42:52.054898 418 mvcc.cc:205] Tried to move back new op lower bound from 7316792000692867072 to 7316792000588009472. Current Snapshot: MvccSnapshot[applied={T|T < 7316792000692867072}]
I20260810 01:42:52.063673 32142 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:52.063830 32142 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53184:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:42:52.066147 32142 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 340412629f4148df9d3e39e18de7067e: Sending DeleteTablet for 3 replicas of tablet b492199937664780a3b59217897c8cc8
I20260810 01:42:52.066963 32742 tablet_service.cc:1514] Processing DeleteTablet for tablet b492199937664780a3b59217897c8cc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:52 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:40660
I20260810 01:42:52.066963 32344 tablet_service.cc:1514] Processing DeleteTablet for tablet b492199937664780a3b59217897c8cc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:52 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:55184
I20260810 01:42:52.067168 32546 tablet_service.cc:1514] Processing DeleteTablet for tablet b492199937664780a3b59217897c8cc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:42:52 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:40552
I20260810 01:42:52.067499 435 tablet_replica.cc:330] T b492199937664780a3b59217897c8cc8 P 5a6d56674b1e4f0abf9ac5bb38767ead: stopping tablet replica
I20260810 01:42:52.067845 440 tablet_replica.cc:330] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: stopping tablet replica
I20260810 01:42:52.067960 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 32239
I20260810 01:42:52.112018 440 raft_consensus.cc:2229] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:42:52.112071 441 tablet_replica.cc:330] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: stopping tablet replica
I20260810 01:42:52.112371 441 raft_consensus.cc:2229] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:42:52.112433 440 raft_consensus.cc:2258] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:52.112818 441 raft_consensus.cc:2258] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:42:52.114094 441 ts_tablet_manager.cc:1905] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:52.114094 440 ts_tablet_manager.cc:1905] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:42:52.116837 440 ts_tablet_manager.cc:1918] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:52.116837 441 ts_tablet_manager.cc:1918] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:42:52.116941 440 log.cc:1196] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/b492199937664780a3b59217897c8cc8
I20260810 01:42:52.116947 441 log.cc:1196] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/b492199937664780a3b59217897c8cc8
I20260810 01:42:52.117254 441 ts_tablet_manager.cc:1939] T b492199937664780a3b59217897c8cc8 P 9694e353c6014cf599ed1bb3dbab49d4: Deleting consensus metadata
I20260810 01:42:52.117254 440 ts_tablet_manager.cc:1939] T b492199937664780a3b59217897c8cc8 P 55797c32e0dd4e35a78ac0c188f90a7c: Deleting consensus metadata
W20260810 01:42:52.117447 32124 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:35371 (error 108)
I20260810 01:42:52.118314 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 32448
I20260810 01:42:52.118443 32120 catalog_manager.cc:4841] TS 55797c32e0dd4e35a78ac0c188f90a7c (127.16.58.67:40775): tablet b492199937664780a3b59217897c8cc8 (table test-table [id=9c1cb58d05994bcf9c678ce542905fbc]) successfully deleted
I20260810 01:42:52.122522 398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:52.122225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:35371 (local address 127.0.0.1:55192)
0810 01:42:52.122384 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:52.122443 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:35371: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260810 01:42:52.122689 32124 catalog_manager.cc:4584] TS 5a6d56674b1e4f0abf9ac5bb38767ead (127.16.58.65:35371): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b492199937664780a3b59217897c8cc8: Network error: Client connection negotiation failed: client connection to 127.16.58.65:35371: connect: Connection refused (error 111)
I20260810 01:42:52.129819 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 32652
I20260810 01:42:52.131264 398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:42:52.129894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:45191 (local address 127.0.0.1:40568)
0810 01:42:52.131144 (+ 1250us) negotiation.cc:107] Waiting for socket to connect
0810 01:42:52.131194 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.66:45191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1173}
I20260810 01:42:52.140091 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 32098
2026-08-10T01:42:52Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2477 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:42:52 dist-test-slave-jlzn krb5kdc[448](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:42:52 dist-test-slave-jlzn krb5kdc[448](info): set up 2 sockets
Aug 10 01:42:52 dist-test-slave-jlzn krb5kdc[448](info): commencing operation
krb5kdc: starting...
W20260810 01:42:53.270153 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:42:53 dist-test-slave-jlzn krb5kdc[448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:42:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:42:53Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.16.58.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.16.58.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/rangeradmin_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/rangeradmin_127.16.58.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.16.58.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.16.58.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/rangerlookup_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/rangerlookup_127.16.58.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.58.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.16.58.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/HTTP_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/HTTP_127.16.58.84@KRBTEST.COM.keytab.
I20260810 01:42:53.421626 16617 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskouGL2L/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/postgres -l logfile start
2026-08-10 01:42:55.587 UTC [498] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 01:42:55.587 UTC [498] LOG: listening on IPv4 address "127.16.58.84", port 42557
2026-08-10 01:42:55.590 UTC [498] LOG: listening on Unix socket "/tmp/.s.PGSQL.42557"
2026-08-10 01:42:55.617 UTC [502] LOG: database system was shut down at 2026-08-10 01:42:54 UTC
2026-08-10 01:42:55.620 UTC [498] LOG: database system is ready to accept connections
I20260810 01:42:56.656960 16617 mini_postgres.cc:96] Postgres bound to 42557
2026-08-10 01:42:56.664 UTC [513] FATAL: database "slave" does not exist
127.16.58.84:42557 - accepting connections
I20260810 01:42:56.664944 16617 mini_ranger.cc:161] Starting Ranger...
I20260810 01:42:56.679502 16617 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 01:42:57.065230 16617 mini_ranger.cc:87] Created ranger Postgres database
I20260810 01:42:57.065317 16617 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-admin
2026-08-10 01:42:57,340 [I] DB FLAVOR :POSTGRES
2026-08-10 01:42:57,340 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 01:42:57,340 [I] Checking connection..
2026-08-10 01:42:57,341 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 01:42:57,594 [I] Checking connection passed.
2026-08-10 01:42:57,595 [I] --------- Verifying version history table ---------
2026-08-10 01:42:57,595 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:42:57,833 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 01:42:57,834 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:42:58,085 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 01:42:58,085 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 01:42:58,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 01:42:58.316 UTC [617] WARNING: there is no transaction in progress
2026-08-10 01:42:58,322 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 01:42:58,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:42:58,563 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 01:42:58,564 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 01:42:58,564 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 01:42:58,814 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 01:42:59,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jlzn.c.gcp-upstream.internal','N') ;"
2026-08-10 01:42:59,305 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 01:42:59,546 [I] Table x_portal_user does not exist in database ranger
2026-08-10 01:42:59,546 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 01:42:59,787 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 01:42:59,787 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 01:43:00,032 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 01:43:00,270 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 01:43:00,271 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 01:43:01.104 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.119 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.132 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.146 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.159 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.174 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.222 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.228 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.241 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.250 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.259 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.271 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.279 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.285 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.290 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01.296 UTC [772] WARNING: there is no transaction in progress
2026-08-10 01:43:01,835 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 01:43:01,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 01:43:02,089 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 01:43:02,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 01:43:02,334 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 01:43:02,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 01:43:02,584 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 01:43:02,585 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 01:43:02,835 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 01:43:03,086 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jlzn.c.gcp-upstream.internal';"
2026-08-10 01:43:03,327 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 01:43:03,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 01:43:03,567 [I] DB_PATCHES have already been applied
I20260810 01:43:03.573455 16617 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-admin:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskouGL2L/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 01:43:03.573518 16617 mini_ranger.cc:193] Using host: 127.16.58.84
I20260810 01:43:03.577963 16617 mini_ranger.cc:227] Ranger admin URL: http://127.16.58.84:58597
Aug 10, 2026 1:43:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 1:43:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 1:43:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 1:43:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 1:43:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 1:43:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 1:43:04 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 01:43:04.825901 16617 mini_ranger.cc:160] Time spent starting Ranger: real 8.161s user 0.001s sys 0.010s
Aug 10, 2026 1:43:23 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 1:43:23 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 1:43:23 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 1:43:23 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 1:43:23 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 01:43:24.564672 16617 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.16.58.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.16.58.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/rangerkms_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/rangerkms_127.16.58.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.58.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.16.58.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.58.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/HTTP_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.58.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/HTTP_127.16.58.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 01:43:24 dist-test-slave-jlzn krb5kdc[448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326204, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 01:43:24.639211 16617 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 01:43:24.647958 16617 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 01:43:25.361951 16617 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 01:43:25.362035 16617 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-kms
I20260810 01:43:25.362142 16617 mini_ranger_kms.cc:227] Using postgres at 127.16.58.84:42557
2026-08-10 01:43:25,536 [I] DB FLAVOR :POSTGRES
2026-08-10 01:43:25,536 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 01:43:25,536 [I] Checking connection
2026-08-10 01:43:25,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 01:43:25,793 [I] connection success
2026-08-10 01:43:25,793 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 01:43:25,793 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 01:43:25,793 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 01:43:26,050 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 01:43:26,050 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 01:43:26,050 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 01:43:26,050 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42557/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 01:43:26,328 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 01:43:26.776803 16617 mini_ranger_kms.cc:310] Created kms service
I20260810 01:43:26.979547 16617 mini_ranger_kms.cc:326] Created kudu user
I20260810 01:43:27.019542 16617 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 01:43:27 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326204, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:43:27.391175 16617 mini_ranger_kms.cc:384] Added ranger policy
I20260810 01:43:27.391320 16617 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-kms:/tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 01:43:27.391340 16617 mini_ranger_kms.cc:240] Using host: 127.16.58.84
I20260810 01:43:27.396610 16617 mini_ranger_kms.cc:276] Ranger KMS PID: 1041
I20260810 01:43:27.396718 16617 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.16.58.84:42593
Aug 10, 2026 1:43:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 1:43:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 1:43:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 1:43:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 1:43:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 1:43:28 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 01:43:29 dist-test-slave-jlzn krb5kdc[448](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786326209, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.58.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:43:29.782682 16617 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.143s user 0.000s sys 0.158s
I20260810 01:43:29.782827 16617 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 01:43:29.782939 16617 mini_ranger_kms.cc:401] 127.16.58.84:42593/kms/v1/keys
Aug 10 01:43:30 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326209, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.58.84@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
Aug 10 01:43:30 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326209, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.58.84@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
Aug 10 01:43:32 dist-test-slave-jlzn krb5kdc[448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326212, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:43:32.626961 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:42263
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:42263
--ranger_config_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:42593/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:43:32.739938 1121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:43:32.740178 1121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:43:32.740216 1121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:43:32.744120 1121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:43:32.744175 1121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:43:32.744194 1121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:43:32.744210 1121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:43:32.744242 1121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:43:32.749382 1121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/wal
--ranger_kms_url=127.16.58.84:42593/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:42263
--ranger_config_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:42263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:43:32.750308 1121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:43:32.751260 1121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:43:32.760102 1127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:43:32.760245 1121 server_base.cc:1034] running on GCE node
W20260810 01:43:32.760159 1126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:43:32.760540 1132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:43:32.761053 1121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:43:32.762128 1121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:43:32.763289 1121 hybrid_clock.cc:648] HybridClock initialized: now 1786326212763267 us; error 45 us; skew 500 ppm
Aug 10 01:43:32 dist-test-slave-jlzn krb5kdc[448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326212, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:43:32.765928 1121 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:43:32.766765 1121 webserver.cc:460] Webserver started at http://127.16.58.126:44651/ using document root <none> and password file <none>
I20260810 01:43:32.767247 1121 fs_manager.cc:359] Metadata directory not provided
I20260810 01:43:32.767302 1121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:43:32.767477 1121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:43:32 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326212, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:43:32.829212 1121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "2e80c87e0c8948c18b83b081d343aa12"
format_stamp: "Formatted at 2026-08-10 01:43:32 on dist-test-slave-jlzn"
server_key: "028b1560fd3d24e46f046e5281acd3f8"
server_key_iv: "e43a0c1d4571eb6dfdf93bf7a071e8eb"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:32.829838 1121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "2e80c87e0c8948c18b83b081d343aa12"
format_stamp: "Formatted at 2026-08-10 01:43:32 on dist-test-slave-jlzn"
server_key: "028b1560fd3d24e46f046e5281acd3f8"
server_key_iv: "e43a0c1d4571eb6dfdf93bf7a071e8eb"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:32.833654 1121 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 01:43:32.850016 1139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:32.851294 1121 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:43:32.851414 1121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "2e80c87e0c8948c18b83b081d343aa12"
format_stamp: "Formatted at 2026-08-10 01:43:32 on dist-test-slave-jlzn"
server_key: "028b1560fd3d24e46f046e5281acd3f8"
server_key_iv: "e43a0c1d4571eb6dfdf93bf7a071e8eb"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:32.851532 1121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:43:32.860998 1121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:43:32.863653 1121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:43:32.863870 1121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:43:32.872119 1121 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:42263
I20260810 01:43:32.872165 1215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:42263 every 8 connection(s)
I20260810 01:43:32.873139 1121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:43:32.875919 1216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:43:32.881409 1216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12: Bootstrap starting.
I20260810 01:43:32.883437 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 1121
I20260810 01:43:32.883558 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:43:32.883899 16617 external_mini_cluster.cc:1428] Setting key 28a13f4ad7170ece452e4478ab86f9d2
I20260810 01:43:32.883898 1216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12: Neither blocks nor log segments found. Creating new log.
I20260810 01:43:32.884734 1216 log.cc:824] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12: Log is configured to *not* fsync() on all Append() calls
I20260810 01:43:32.886607 1216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12: No bootstrap required, opened a new log
I20260810 01:43:32.890413 1216 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e80c87e0c8948c18b83b081d343aa12" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42263 } }
I20260810 01:43:32.890718 1216 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:43:32.890784 1216 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e80c87e0c8948c18b83b081d343aa12, State: Initialized, Role: FOLLOWER
I20260810 01:43:32.891212 1216 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e80c87e0c8948c18b83b081d343aa12" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42263 } }
I20260810 01:43:32.891342 1216 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:43:32.891424 1216 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:43:32.891542 1216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:43:32.892475 1216 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e80c87e0c8948c18b83b081d343aa12" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42263 } }
I20260810 01:43:32.892798 1216 leader_election.cc:302] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e80c87e0c8948c18b83b081d343aa12; no voters:
I20260810 01:43:32.893092 1216 leader_election.cc:288] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 10 01:43:32 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326212, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:43:32.894384 1216 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:43:32.893752 1226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:43:32.895265 1226 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [term 1 LEADER]: Becoming Leader. State: Replica: 2e80c87e0c8948c18b83b081d343aa12, State: Running, Role: LEADER
I20260810 01:43:32.895576 1226 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e80c87e0c8948c18b83b081d343aa12" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42263 } }
I20260810 01:43:32.896745 1226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e80c87e0c8948c18b83b081d343aa12. Latest consensus state: current_term: 1 leader_uuid: "2e80c87e0c8948c18b83b081d343aa12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e80c87e0c8948c18b83b081d343aa12" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42263 } } }
I20260810 01:43:32.897389 1216 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 01:43:32.897432 1226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [sys.catalog]: This master's current role is: LEADER
I20260810 01:43:32.897330 1227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e80c87e0c8948c18b83b081d343aa12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e80c87e0c8948c18b83b081d343aa12" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 42263 } } }
I20260810 01:43:32.897605 1227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12 [sys.catalog]: This master's current role is: LEADER
I20260810 01:43:32.902714 1251 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:43:32.903227 1224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:32.885038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44218 (local address 127.16.58.126:42263)
0810 01:43:32.885450 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:32.885468 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:32.885509 (+ 41us) server_negotiation.cc:407] Connection header received
0810 01:43:32.886316 (+ 807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:32.886340 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:32.886725 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:32.887067 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:43:32.887958 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:32.889452 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:32.890647 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:32.891349 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:32.891971 (+ 622us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:32.894438 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:43:32.894445 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:43:32.894461 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:43:32.894491 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:43:32.896545 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:32.897068 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:32.897074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:32.897079 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:32.897225 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:32.897548 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:32.897551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:32.897553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:32.898047 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:43:32.898256 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:32.899108 (+ 852us) server_negotiation.cc:299] Negotiation successful
0810 01:43:32.901328 (+ 2220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":113,"threads_started":1}
I20260810 01:43:32.907837 1251 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:43:32.915972 1251 catalog_manager.cc:1347] Generated new cluster ID: 9fee8859426e45589af70a53ed859179
I20260810 01:43:32.916087 1251 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:43:32.937788 1251 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:43:32.939097 1251 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:43:32.950681 1251 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12: Generated new TSK 0
I20260810 01:43:32.951610 1251 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:43:33.620920 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:42593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:42263
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:43:33.756815 1287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:43:33.757121 1287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:43:33.757190 1287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:43:33.762324 1287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:43:33.762398 1287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:43:33.762480 1287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:43:33.767769 1287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.16.58.84:42593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:43:33.768761 1287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:43:33.769961 1287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:43:33.781423 1301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:43:33.781510 1304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:43:33.781757 1308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:43:33.782315 1287 server_base.cc:1034] running on GCE node
I20260810 01:43:33.782711 1287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:43:33.783334 1287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:43:33.784494 1287 hybrid_clock.cc:648] HybridClock initialized: now 1786326213784461 us; error 52 us; skew 500 ppm
Aug 10 01:43:33 dist-test-slave-jlzn krb5kdc[448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:43:33.788383 1287 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:43:33.789471 1287 webserver.cc:460] Webserver started at http://127.16.58.65:34913/ using document root <none> and password file <none>
I20260810 01:43:33.790171 1287 fs_manager.cc:359] Metadata directory not provided
I20260810 01:43:33.790271 1287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:43:33.790578 1287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:43:33 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:43:33.808054 1287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "73331cd7c06b4ff6928de0cd20e8450e"
format_stamp: "Formatted at 2026-08-10 01:43:33 on dist-test-slave-jlzn"
server_key: "758409dd022e8b7e34a919a15f64e71b"
server_key_iv: "4394e93037b854c892879719adb175ce"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:33.808804 1287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "73331cd7c06b4ff6928de0cd20e8450e"
format_stamp: "Formatted at 2026-08-10 01:43:33 on dist-test-slave-jlzn"
server_key: "758409dd022e8b7e34a919a15f64e71b"
server_key_iv: "4394e93037b854c892879719adb175ce"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:33.814082 1287 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 01:43:33.835590 1315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:33.837244 1287 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.000s
I20260810 01:43:33.837370 1287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "73331cd7c06b4ff6928de0cd20e8450e"
format_stamp: "Formatted at 2026-08-10 01:43:33 on dist-test-slave-jlzn"
server_key: "758409dd022e8b7e34a919a15f64e71b"
server_key_iv: "4394e93037b854c892879719adb175ce"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:33.837502 1287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:43:33.853293 1287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:43:33.856750 1287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:43:33.856938 1287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:43:33.857630 1287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:43:33.858670 1287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:43:33.858741 1287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:33.858801 1287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:43:33.858877 1287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:33.867625 1287 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:36779
I20260810 01:43:33.867683 1491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:36779 every 8 connection(s)
I20260810 01:43:33.868760 1287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:43:33.869056 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 1287
I20260810 01:43:33.869184 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:43:33.869493 16617 external_mini_cluster.cc:1428] Setting key 5fae23f72804a1541e83338b754ecd31
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
Aug 10 01:43:33 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:43:33.897141 1498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:33.879972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:53237 (local address 127.16.58.126:42263)
0810 01:43:33.882780 (+ 2808us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:33.882789 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:33.882805 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:43:33.882846 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:33.882849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:33.882897 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:33.884429 (+ 1532us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:43:33.884537 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:33.886886 (+ 2349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:33.888627 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:33.888973 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:33.889091 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:33.891918 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:43:33.891923 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:43:33.891926 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:43:33.891952 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:43:33.893669 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:33.894302 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:33.894305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:33.894307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:33.894402 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:33.894856 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:33.894859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:33.894861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:33.895133 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:43:33.895239 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:33.896846 (+ 1607us) server_negotiation.cc:299] Negotiation successful
0810 01:43:33.896970 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2723,"thread_start_us":126,"threads_started":1}
I20260810 01:43:33.897984 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:33.871549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:42263 (local address 127.16.58.65:53237)
0810 01:43:33.872845 (+ 1296us) negotiation.cc:107] Waiting for socket to connect
0810 01:43:33.872899 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 01:43:33.873887 (+ 988us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:43:33.883235 (+ 9348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:43:33.883245 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:43:33.883589 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:43:33.884278 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:33.884297 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:33.887056 (+ 2759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:33.887060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:33.888471 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:33.888484 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:33.889173 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:33.889178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:33.889376 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:33.890034 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:43:33.890054 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:43:33.891695 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:43:33.893795 (+ 2100us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:43:33.893800 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:43:33.893815 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:43:33.894194 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:43:33.894509 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:43:33.894512 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:43:33.894514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:43:33.894704 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:43:33.895295 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:43:33.895301 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:43:33.895692 (+ 391us) client_negotiation.cc:769] Sending connection context
0810 01:43:33.895933 (+ 241us) client_negotiation.cc:240] Negotiation successful
0810 01:43:33.896267 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1076,"thread_start_us":165,"threads_started":1}
I20260810 01:43:33.899523 1492 heartbeater.cc:347] Connected to a master server at 127.16.58.126:42263
I20260810 01:43:33.899887 1492 heartbeater.cc:464] Registering TS with master...
I20260810 01:43:33.900465 1492 heartbeater.cc:511] Master 127.16.58.126:42263 requested a full tablet report, sending...
I20260810 01:43:33.902233 1161 ts_manager.cc:194] Registered new tserver with Master: 73331cd7c06b4ff6928de0cd20e8450e (127.16.58.65:36779)
I20260810 01:43:33.903713 1161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:53237
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:43:33.907446 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:42593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:42263
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:43:33 dist-test-slave-jlzn krb5kdc[448](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786326213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 01:43:34.087847 1503 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:43:34.088167 1503 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:43:34.088231 1503 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:43:34.094151 1503 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:43:34.094260 1503 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:43:34.094359 1503 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:43:34.101913 1503 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.16.58.84:42593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1503
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:43:34.103363 1503 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:43:34.104658 1503 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:43:34.117933 1517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:43:34.118100 1512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:43:34.118888 1513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:43:34.119197 1503 server_base.cc:1034] running on GCE node
I20260810 01:43:34.119637 1503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:43:34.120370 1503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:43:34.121555 1503 hybrid_clock.cc:648] HybridClock initialized: now 1786326214121538 us; error 30 us; skew 500 ppm
Aug 10 01:43:34 dist-test-slave-jlzn krb5kdc[448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:43:34.125231 1503 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:43:34.126237 1503 webserver.cc:460] Webserver started at http://127.16.58.66:37199/ using document root <none> and password file <none>
I20260810 01:43:34.126924 1503 fs_manager.cc:359] Metadata directory not provided
I20260810 01:43:34.127024 1503 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:43:34.127316 1503 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:43:34 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:43:34.145321 1503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "0d953358fbc0425ea04f63f92bdaee53"
format_stamp: "Formatted at 2026-08-10 01:43:34 on dist-test-slave-jlzn"
server_key: "79f7235dd9ceef2593bb954e85496944"
server_key_iv: "2411251822e8fadbd31fd4c9681873c1"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:34.146140 1503 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "0d953358fbc0425ea04f63f92bdaee53"
format_stamp: "Formatted at 2026-08-10 01:43:34 on dist-test-slave-jlzn"
server_key: "79f7235dd9ceef2593bb954e85496944"
server_key_iv: "2411251822e8fadbd31fd4c9681873c1"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:34.151405 1503 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260810 01:43:34.175341 1526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:34.179586 1503 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.003s sys 0.001s
I20260810 01:43:34.179870 1503 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "0d953358fbc0425ea04f63f92bdaee53"
format_stamp: "Formatted at 2026-08-10 01:43:34 on dist-test-slave-jlzn"
server_key: "79f7235dd9ceef2593bb954e85496944"
server_key_iv: "2411251822e8fadbd31fd4c9681873c1"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:34.180119 1503 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:43:34.212942 1503 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:43:34.215777 1503 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:43:34.215973 1503 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:43:34.216548 1503 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:43:34.217478 1503 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:43:34.217540 1503 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:34.217602 1503 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:43:34.217638 1503 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:34.230882 1503 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:34933
I20260810 01:43:34.231002 1686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:34933 every 8 connection(s)
I20260810 01:43:34.231920 1503 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:43:34.239741 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 1503
I20260810 01:43:34.239935 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:43:34.240327 16617 external_mini_cluster.cc:1428] Setting key 53dd0977f3e4c50fb991bf64af63436e
Aug 10 01:43:34 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:43:34.245642 1498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.233817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:54307 (local address 127.16.58.126:42263)
0810 01:43:34.233942 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:34.233945 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:34.234995 (+ 1050us) server_negotiation.cc:407] Connection header received
0810 01:43:34.235978 (+ 983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:34.235982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:34.236043 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:34.236116 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:43:34.237210 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.237762 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.238887 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.239193 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.239290 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.241949 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:43:34.241953 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:43:34.241955 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:43:34.241983 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:43:34.243394 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:34.243910 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:34.243914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:34.243916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:34.244009 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:34.244350 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:34.244354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:34.244355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:34.244542 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:43:34.244648 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:34.245320 (+ 672us) server_negotiation.cc:299] Negotiation successful
0810 01:43:34.245451 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:43:34.247037 1689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.234345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:42263 (local address 127.16.58.66:54307)
0810 01:43:34.234840 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0810 01:43:34.234882 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:43:34.235733 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:43:34.236318 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:43:34.236324 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:43:34.236592 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:43:34.237055 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.237070 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.237885 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.237889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.238765 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.238776 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.239345 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.239350 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.239514 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.240094 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:43:34.240110 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:43:34.241787 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:43:34.243504 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:43:34.243510 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:43:34.243525 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:43:34.243826 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:43:34.244093 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:43:34.244096 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:43:34.244098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:43:34.244252 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:43:34.244709 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:43:34.244715 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:43:34.245037 (+ 322us) client_negotiation.cc:769] Sending connection context
0810 01:43:34.245845 (+ 808us) client_negotiation.cc:240] Negotiation successful
0810 01:43:34.246185 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":144,"threads_started":1}
I20260810 01:43:34.248296 1687 heartbeater.cc:347] Connected to a master server at 127.16.58.126:42263
I20260810 01:43:34.248539 1687 heartbeater.cc:464] Registering TS with master...
I20260810 01:43:34.249096 1687 heartbeater.cc:511] Master 127.16.58.126:42263 requested a full tablet report, sending...
I20260810 01:43:34.250236 1161 ts_manager.cc:194] Registered new tserver with Master: 0d953358fbc0425ea04f63f92bdaee53 (127.16.58.66:34933)
I20260810 01:43:34.250968 1161 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:54307
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:43:34.280884 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:42593/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:42263
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:43:34 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
W20260810 01:43:34.417760 1694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:43:34.418462 1694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:43:34.418587 1694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:43:34.424243 1694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:43:34.424338 1694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:43:34.424439 1694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:43:34.431583 1694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.16.58.84:42593/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:43:34.432935 1694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:43:34.434206 1694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:43:34.450232 1705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:43:34.450238 1701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:43:34.454465 1700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:43:34.455650 1694 server_base.cc:1034] running on GCE node
I20260810 01:43:34.456250 1694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:43:34.457085 1694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:43:34.458310 1694 hybrid_clock.cc:648] HybridClock initialized: now 1786326214458238 us; error 87 us; skew 500 ppm
Aug 10 01:43:34 dist-test-slave-jlzn krb5kdc[448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:43:34.461894 1694 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:43:34.463019 1694 webserver.cc:460] Webserver started at http://127.16.58.67:41855/ using document root <none> and password file <none>
I20260810 01:43:34.463725 1694 fs_manager.cc:359] Metadata directory not provided
I20260810 01:43:34.463830 1694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:43:34.464087 1694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:43:34 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:43:34.498912 1694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "57ff22b43c414821899f0b75a3980ef6"
format_stamp: "Formatted at 2026-08-10 01:43:34 on dist-test-slave-jlzn"
server_key: "6bfed7a5d8f74d24aedd6391cdae9007"
server_key_iv: "01a2e38f6de13eee8a75886380554edb"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:34.499733 1694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "57ff22b43c414821899f0b75a3980ef6"
format_stamp: "Formatted at 2026-08-10 01:43:34 on dist-test-slave-jlzn"
server_key: "6bfed7a5d8f74d24aedd6391cdae9007"
server_key_iv: "01a2e38f6de13eee8a75886380554edb"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:34.504925 1694 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 01:43:34.532225 1714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:34.534132 1694 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.001s sys 0.002s
I20260810 01:43:34.534284 1694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "57ff22b43c414821899f0b75a3980ef6"
format_stamp: "Formatted at 2026-08-10 01:43:34 on dist-test-slave-jlzn"
server_key: "6bfed7a5d8f74d24aedd6391cdae9007"
server_key_iv: "01a2e38f6de13eee8a75886380554edb"
server_key_version: "kuduclusterkey@0"
I20260810 01:43:34.534410 1694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:43:34.559765 1694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:43:34.562449 1694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:43:34.562625 1694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:43:34.563282 1694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:43:34.564350 1694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:43:34.564402 1694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:34.564455 1694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:43:34.564484 1694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:43:34.576399 1694 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:41309
I20260810 01:43:34.577361 1694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:43:34.584383 1891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:41309 every 8 connection(s)
I20260810 01:43:34.587157 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 1694
I20260810 01:43:34.587270 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:43:34.587570 16617 external_mini_cluster.cc:1428] Setting key 41d4fd8ff2dd670e84f749bbe784ba2d
Aug 10 01:43:34 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326214, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:43:34.597182 1498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.586833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:54799 (local address 127.16.58.126:42263)
0810 01:43:34.586978 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:34.586982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:34.587001 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:43:34.587684 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:34.587688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:34.587745 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:34.587820 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:43:34.589363 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.590010 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.591177 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.591395 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.591481 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.593699 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:43:34.593703 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:43:34.593706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:43:34.593732 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:43:34.595039 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:34.595629 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:34.595633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:34.595635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:34.595717 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:34.596056 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:34.596059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:34.596061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:34.596268 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:43:34.596359 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:34.596907 (+ 548us) server_negotiation.cc:299] Negotiation successful
0810 01:43:34.597019 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:43:34.598102 1894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.585846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:42263 (local address 127.16.58.67:54799)
0810 01:43:34.586365 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0810 01:43:34.586417 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:43:34.587432 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:43:34.588248 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:43:34.588256 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:43:34.588581 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:43:34.589229 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.589246 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.590133 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.590136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.591060 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.591071 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.591542 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.591546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.591720 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.592277 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:43:34.592293 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:43:34.593548 (+ 1255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:43:34.595154 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:43:34.595160 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:43:34.595173 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:43:34.595508 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:43:34.595820 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:43:34.595823 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:43:34.595826 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:43:34.595965 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:43:34.596415 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:43:34.596421 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:43:34.596672 (+ 251us) client_negotiation.cc:769] Sending connection context
0810 01:43:34.596827 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 01:43:34.597116 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":136,"threads_started":1}
I20260810 01:43:34.599182 1892 heartbeater.cc:347] Connected to a master server at 127.16.58.126:42263
I20260810 01:43:34.599391 1892 heartbeater.cc:464] Registering TS with master...
I20260810 01:43:34.599859 1892 heartbeater.cc:511] Master 127.16.58.126:42263 requested a full tablet report, sending...
I20260810 01:43:34.600978 1164 ts_manager.cc:194] Registered new tserver with Master: 57ff22b43c414821899f0b75a3980ef6 (127.16.58.67:41309)
I20260810 01:43:34.601730 1164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:54799
I20260810 01:43:34.602442 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:43:34.615198 1498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.608166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44232 (local address 127.16.58.126:42263)
0810 01:43:34.608266 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:34.608269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:34.608493 (+ 224us) server_negotiation.cc:407] Connection header received
0810 01:43:34.608599 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:34.608602 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:34.608640 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:34.608703 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:43:34.609337 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.609818 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.610642 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.610858 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.610940 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.612196 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:43:34.612199 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:43:34.612202 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:43:34.612226 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:43:34.613433 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:34.613830 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:34.613834 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:34.613835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:34.613913 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:43:34.614164 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:43:34.614167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:43:34.614169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:43:34.614328 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:43:34.614596 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:34.614951 (+ 355us) server_negotiation.cc:299] Negotiation successful
0810 01:43:34.615061 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:43:34.617816 1161 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44232:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:43:34.621094 1161 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:43:34.636934 1917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.629326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:41309 (local address 127.0.0.1:50612)
0810 01:43:34.631533 (+ 2207us) negotiation.cc:107] Waiting for socket to connect
0810 01:43:34.631573 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:43:34.631698 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:43:34.632403 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:43:34.632408 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:43:34.632429 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:43:34.632547 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.632554 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.633855 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.633859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.635161 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.635170 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.636413 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.636417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.636521 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.636577 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 01:43:34.636670 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 01:43:34.636779 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2027,"spinlock_wait_cycles":4224,"thread_start_us":85,"threads_started":1}
I20260810 01:43:34.637466 1916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.630130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50612 (local address 127.16.58.67:41309)
0810 01:43:34.631329 (+ 1199us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:34.631341 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:34.631840 (+ 499us) server_negotiation.cc:407] Connection header received
0810 01:43:34.631917 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:34.631922 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:34.632113 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:34.632252 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:43:34.632672 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.633736 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.635308 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.636114 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.636209 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.636354 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:34.637236 (+ 882us) server_negotiation.cc:299] Negotiation successful
0810 01:43:34.637332 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1101,"thread_start_us":114,"threads_started":1}
I20260810 01:43:34.638427 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.629417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:36779 (local address 127.0.0.1:47422)
0810 01:43:34.631525 (+ 2108us) negotiation.cc:107] Waiting for socket to connect
0810 01:43:34.631573 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:43:34.631698 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:43:34.632532 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:43:34.632535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:43:34.632550 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:43:34.632618 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.632624 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.634979 (+ 2355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.634982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.636185 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.636195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.638067 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.638071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.638157 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.638179 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:43:34.638246 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 01:43:34.638307 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1980,"spinlock_wait_cycles":6016,"thread_start_us":82,"threads_started":1}
I20260810 01:43:34.638824 1914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.630101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47422 (local address 127.16.58.65:36779)
0810 01:43:34.631997 (+ 1896us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:34.632003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:34.632041 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:43:34.632108 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:34.632113 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:34.632271 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:34.632399 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:43:34.633003 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.634851 (+ 1848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.636306 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.637761 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.637864 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.637997 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:34.638586 (+ 589us) server_negotiation.cc:299] Negotiation successful
0810 01:43:34.638687 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1796,"thread_start_us":122,"threads_started":1}
I20260810 01:43:34.641191 1764 tablet_service.cc:1467] Processing CreateTablet for tablet a24f88792f444121bb1a40c6c6d07928 (DEFAULT_TABLE table=test-table [id=4e5789f17781493a91552b9d497c7bc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:43:34.642334 1764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a24f88792f444121bb1a40c6c6d07928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:43:34.646442 1396 tablet_service.cc:1467] Processing CreateTablet for tablet a24f88792f444121bb1a40c6c6d07928 (DEFAULT_TABLE table=test-table [id=4e5789f17781493a91552b9d497c7bc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:43:34.647253 1396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a24f88792f444121bb1a40c6c6d07928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:43:34.648985 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.630968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34933 (local address 127.0.0.1:36552)
0810 01:43:34.632804 (+ 1836us) negotiation.cc:107] Waiting for socket to connect
0810 01:43:34.632816 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:43:34.632893 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:43:34.644501 (+ 11608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:43:34.644516 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:43:34.644536 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:43:34.644622 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.644628 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.646243 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.646246 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.647429 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.647441 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.648620 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.648624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.648715 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.648739 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:43:34.648795 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 01:43:34.648860 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1777,"thread_start_us":98,"threads_started":1}
I20260810 01:43:34.649622 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.631151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36552 (local address 127.16.58.66:34933)
0810 01:43:34.644031 (+ 12880us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:34.644042 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:34.644069 (+ 27us) server_negotiation.cc:407] Connection header received
0810 01:43:34.644147 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:34.644152 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:34.644335 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:34.644795 (+ 460us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:43:34.644952 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.646105 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.647616 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.648453 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.649183 (+ 730us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.649328 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:34.649376 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 01:43:34.649460 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12764,"thread_start_us":118,"threads_started":1}
I20260810 01:43:34.652252 1591 tablet_service.cc:1467] Processing CreateTablet for tablet a24f88792f444121bb1a40c6c6d07928 (DEFAULT_TABLE table=test-table [id=4e5789f17781493a91552b9d497c7bc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:43:34.653264 1591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a24f88792f444121bb1a40c6c6d07928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:43:34.656613 1920 tablet_bootstrap.cc:492] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: Bootstrap starting.
I20260810 01:43:34.660113 1920 tablet_bootstrap.cc:654] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: Neither blocks nor log segments found. Creating new log.
I20260810 01:43:34.660983 1920 log.cc:824] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:43:34.661301 1921 tablet_bootstrap.cc:492] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: Bootstrap starting.
I20260810 01:43:34.664162 1921 tablet_bootstrap.cc:654] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: Neither blocks nor log segments found. Creating new log.
I20260810 01:43:34.665228 1921 log.cc:824] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: Log is configured to *not* fsync() on all Append() calls
I20260810 01:43:34.667694 1921 tablet_bootstrap.cc:492] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: No bootstrap required, opened a new log
I20260810 01:43:34.667914 1920 tablet_bootstrap.cc:492] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: No bootstrap required, opened a new log
I20260810 01:43:34.667919 1921 ts_tablet_manager.cc:1397] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 01:43:34.668145 1920 ts_tablet_manager.cc:1397] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260810 01:43:34.668861 1919 tablet_bootstrap.cc:492] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e: Bootstrap starting.
I20260810 01:43:34.671063 1919 tablet_bootstrap.cc:654] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e: Neither blocks nor log segments found. Creating new log.
I20260810 01:43:34.671730 1921 raft_consensus.cc:348] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } }
I20260810 01:43:34.671932 1919 log.cc:824] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:43:34.672055 1921 raft_consensus.cc:374] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:43:34.672147 1921 raft_consensus.cc:729] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d953358fbc0425ea04f63f92bdaee53, State: Initialized, Role: FOLLOWER
I20260810 01:43:34.671797 1920 raft_consensus.cc:348] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } }
I20260810 01:43:34.672379 1920 raft_consensus.cc:374] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:43:34.672544 1920 raft_consensus.cc:729] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57ff22b43c414821899f0b75a3980ef6, State: Initialized, Role: FOLLOWER
I20260810 01:43:34.672638 1921 consensus_queue.cc:260] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } }
I20260810 01:43:34.673004 1920 consensus_queue.cc:260] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } }
I20260810 01:43:34.673712 1921 ts_tablet_manager.cc:1428] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:43:34.673914 1920 ts_tablet_manager.cc:1428] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:43:34.674124 1687 heartbeater.cc:503] Master 127.16.58.126:42263 was elected leader, sending a full tablet report...
I20260810 01:43:34.674265 1892 heartbeater.cc:503] Master 127.16.58.126:42263 was elected leader, sending a full tablet report...
I20260810 01:43:34.685324 1919 tablet_bootstrap.cc:492] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e: No bootstrap required, opened a new log
I20260810 01:43:34.685498 1919 ts_tablet_manager.cc:1397] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.003s
I20260810 01:43:34.689056 1919 raft_consensus.cc:348] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } }
I20260810 01:43:34.689386 1919 raft_consensus.cc:374] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:43:34.689471 1919 raft_consensus.cc:729] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73331cd7c06b4ff6928de0cd20e8450e, State: Initialized, Role: FOLLOWER
I20260810 01:43:34.689908 1919 consensus_queue.cc:260] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } }
I20260810 01:43:34.690582 1492 heartbeater.cc:503] Master 127.16.58.126:42263 was elected leader, sending a full tablet report...
I20260810 01:43:34.690935 1919 ts_tablet_manager.cc:1428] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
Aug 10 01:43:34 dist-test-slave-jlzn krb5kdc[448](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326213, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
W20260810 01:43:34.733264 1688 tablet.cc:2369] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:43:34.736207 1934 raft_consensus.cc:482] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:43:34.736421 1934 raft_consensus.cc:504] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } }
I20260810 01:43:34.737758 1934 leader_election.cc:288] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57ff22b43c414821899f0b75a3980ef6 (127.16.58.67:41309), 0d953358fbc0425ea04f63f92bdaee53 (127.16.58.66:34933)
I20260810 01:43:34.743722 1916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.738385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:38485 (local address 127.16.58.67:41309)
0810 01:43:34.738568 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:34.738573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:34.738752 (+ 179us) server_negotiation.cc:407] Connection header received
0810 01:43:34.738961 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:34.738965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:34.739018 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:34.739065 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:43:34.739522 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.740288 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.742364 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.742953 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.743049 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.743105 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:34.743482 (+ 377us) server_negotiation.cc:299] Negotiation successful
0810 01:43:34.743588 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 01:43:34.744408 1936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.737958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:41309 (local address 127.16.58.65:38485)
0810 01:43:34.738654 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0810 01:43:34.738670 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:43:34.738843 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:43:34.739212 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:43:34.739215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:43:34.739234 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:43:34.739383 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.739389 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.740476 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.740528 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.742226 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.742238 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.743229 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.743233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.743329 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.743356 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 01:43:34.744170 (+ 814us) client_negotiation.cc:240] Negotiation successful
0810 01:43:34.744254 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":123,"threads_started":1}
I20260810 01:43:34.745352 1819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a24f88792f444121bb1a40c6c6d07928" candidate_uuid: "73331cd7c06b4ff6928de0cd20e8450e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57ff22b43c414821899f0b75a3980ef6" is_pre_election: true
I20260810 01:43:34.745687 1819 raft_consensus.cc:2454] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73331cd7c06b4ff6928de0cd20e8450e in term 0.
I20260810 01:43:34.746335 1317 leader_election.cc:302] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57ff22b43c414821899f0b75a3980ef6, 73331cd7c06b4ff6928de0cd20e8450e; no voters:
I20260810 01:43:34.746744 1934 raft_consensus.cc:2781] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:43:34.746840 1934 raft_consensus.cc:482] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:43:34.746891 1934 raft_consensus.cc:3037] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:43:34.748575 1934 raft_consensus.cc:504] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } }
I20260810 01:43:34.749353 1819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a24f88792f444121bb1a40c6c6d07928" candidate_uuid: "73331cd7c06b4ff6928de0cd20e8450e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57ff22b43c414821899f0b75a3980ef6"
I20260810 01:43:34.749480 1819 raft_consensus.cc:3037] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:43:34.750880 1819 raft_consensus.cc:2454] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73331cd7c06b4ff6928de0cd20e8450e in term 1.
I20260810 01:43:34.751299 1317 leader_election.cc:302] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57ff22b43c414821899f0b75a3980ef6, 73331cd7c06b4ff6928de0cd20e8450e; no voters:
I20260810 01:43:34.751796 1934 leader_election.cc:288] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [CANDIDATE]: Term 1 election: Requested vote from peers 57ff22b43c414821899f0b75a3980ef6 (127.16.58.67:41309), 0d953358fbc0425ea04f63f92bdaee53 (127.16.58.66:34933)
I20260810 01:43:34.751973 1934 raft_consensus.cc:2781] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:43:34.752116 1934 raft_consensus.cc:686] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [term 1 LEADER]: Becoming Leader. State: Replica: 73331cd7c06b4ff6928de0cd20e8450e, State: Running, Role: LEADER
I20260810 01:43:34.752517 1934 consensus_queue.cc:237] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } }
I20260810 01:43:34.756146 1164 catalog_manager.cc:5495] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e reported cstate change: term changed from 0 to 1, leader changed from <none> to 73331cd7c06b4ff6928de0cd20e8450e (127.16.58.65). New cstate: current_term: 1 leader_uuid: "73331cd7c06b4ff6928de0cd20e8450e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73331cd7c06b4ff6928de0cd20e8450e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 } health_report { overall_health: UNKNOWN } } }
I20260810 01:43:34.762360 1918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.738409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:50945 (local address 127.16.58.66:34933)
0810 01:43:34.738659 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:34.738664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:34.743967 (+ 5303us) server_negotiation.cc:407] Connection header received
0810 01:43:34.744085 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:34.744094 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:34.744178 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:34.744277 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:43:34.757393 (+ 13116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.758216 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.760981 (+ 2765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.761590 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.761726 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.761788 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:34.762137 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 01:43:34.762227 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
I20260810 01:43:34.762961 1937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.738043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34933 (local address 127.16.58.65:50945)
0810 01:43:34.741746 (+ 3703us) negotiation.cc:107] Waiting for socket to connect
0810 01:43:34.741761 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:43:34.741864 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:43:34.755401 (+ 13537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:43:34.755405 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:43:34.755425 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:43:34.757230 (+ 1805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.757242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.759590 (+ 2348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.759593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.760849 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:43:34.760861 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.761863 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.761867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:43:34.761978 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.762006 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 01:43:34.762729 (+ 723us) client_negotiation.cc:240] Negotiation successful
0810 01:43:34.762812 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3632,"thread_start_us":95,"threads_started":1}
I20260810 01:43:34.763979 1620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a24f88792f444121bb1a40c6c6d07928" candidate_uuid: "73331cd7c06b4ff6928de0cd20e8450e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d953358fbc0425ea04f63f92bdaee53"
I20260810 01:43:34.764240 1620 raft_consensus.cc:3037] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:43:34.765628 1620 raft_consensus.cc:2454] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73331cd7c06b4ff6928de0cd20e8450e in term 1.
I20260810 01:43:34.763998 1625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a24f88792f444121bb1a40c6c6d07928" candidate_uuid: "73331cd7c06b4ff6928de0cd20e8450e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d953358fbc0425ea04f63f92bdaee53" is_pre_election: true
I20260810 01:43:34.766079 1625 raft_consensus.cc:2362] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73331cd7c06b4ff6928de0cd20e8450e in term 1. Re-sending same reply.
I20260810 01:43:34.788543 1914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.782307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47434 (local address 127.16.58.65:36779)
0810 01:43:34.782420 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:43:34.782423 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:43:34.783593 (+ 1170us) server_negotiation.cc:407] Connection header received
0810 01:43:34.783678 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:43:34.783681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:43:34.783748 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:43:34.783933 (+ 185us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:43:34.784591 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.785404 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.786757 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:43:34.787097 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:43:34.787202 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:43:34.787563 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:43:34.788133 (+ 570us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:43:34.788246 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:43:34.788348 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 01:43:34.788408 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:43:34.795711 1625 raft_consensus.cc:1261] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [term 1 FOLLOWER]: Refusing update from remote peer 73331cd7c06b4ff6928de0cd20e8450e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:43:34.796819 1938 consensus_queue.cc:1035] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d953358fbc0425ea04f63f92bdaee53" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:43:34.803457 1819 raft_consensus.cc:1261] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [term 1 FOLLOWER]: Refusing update from remote peer 73331cd7c06b4ff6928de0cd20e8450e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:43:34.804176 1938 consensus_queue.cc:1035] T a24f88792f444121bb1a40c6c6d07928 P 73331cd7c06b4ff6928de0cd20e8450e [LEADER]: Connected to new peer: Peer: permanent_uuid: "57ff22b43c414821899f0b75a3980ef6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:43:34.831604 1947 mvcc.cc:205] Tried to move back new op lower bound from 7316792175794163712 to 7316792175629959168. Current Snapshot: MvccSnapshot[applied={T|T < 7316792175794163712}]
I20260810 01:43:34.841753 1954 mvcc.cc:205] Tried to move back new op lower bound from 7316792175794163712 to 7316792175629959168. Current Snapshot: MvccSnapshot[applied={T|T < 7316792175794163712}]
I20260810 01:43:34.843752 1950 mvcc.cc:205] Tried to move back new op lower bound from 7316792175794163712 to 7316792175629959168. Current Snapshot: MvccSnapshot[applied={T|T < 7316792175794163712}]
I20260810 01:43:34.854630 1164 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:43:34.854800 1164 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:43:34.857577 1164 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2e80c87e0c8948c18b83b081d343aa12: Sending DeleteTablet for 3 replicas of tablet a24f88792f444121bb1a40c6c6d07928
I20260810 01:43:34.858933 1764 tablet_service.cc:1514] Processing DeleteTablet for tablet a24f88792f444121bb1a40c6c6d07928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:43:34 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:50612
I20260810 01:43:34.859427 1396 tablet_service.cc:1514] Processing DeleteTablet for tablet a24f88792f444121bb1a40c6c6d07928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:43:34 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:47422
I20260810 01:43:34.859944 1591 tablet_service.cc:1514] Processing DeleteTablet for tablet a24f88792f444121bb1a40c6c6d07928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:43:34 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:36552
I20260810 01:43:34.861238 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 1287
I20260810 01:43:34.878350 1961 tablet_replica.cc:330] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: stopping tablet replica
I20260810 01:43:34.880072 1964 tablet_replica.cc:330] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: stopping tablet replica
I20260810 01:43:34.880524 1961 raft_consensus.cc:2229] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:43:34.880970 1964 raft_consensus.cc:2229] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:43:34.881389 1964 raft_consensus.cc:2258] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:43:34.881750 1961 raft_consensus.cc:2258] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:43:34.885208 1961 ts_tablet_manager.cc:1905] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:43:34.886130 1964 ts_tablet_manager.cc:1905] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:43:34.888911 1964 ts_tablet_manager.cc:1918] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:43:34.892549 1964 log.cc:1196] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/a24f88792f444121bb1a40c6c6d07928
I20260810 01:43:34.892961 1964 ts_tablet_manager.cc:1939] T a24f88792f444121bb1a40c6c6d07928 P 0d953358fbc0425ea04f63f92bdaee53: Deleting consensus metadata
I20260810 01:43:34.893513 1961 ts_tablet_manager.cc:1918] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:43:34.893677 1961 log.cc:1196] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/a24f88792f444121bb1a40c6c6d07928
I20260810 01:43:34.894047 1961 ts_tablet_manager.cc:1939] T a24f88792f444121bb1a40c6c6d07928 P 57ff22b43c414821899f0b75a3980ef6: Deleting consensus metadata
I20260810 01:43:34.894485 1143 catalog_manager.cc:4841] TS 0d953358fbc0425ea04f63f92bdaee53 (127.16.58.66:34933): tablet a24f88792f444121bb1a40c6c6d07928 (table test-table [id=4e5789f17781493a91552b9d497c7bc1]) successfully deleted
I20260810 01:43:34.895241 1141 catalog_manager.cc:4841] TS 57ff22b43c414821899f0b75a3980ef6 (127.16.58.67:41309): tablet a24f88792f444121bb1a40c6c6d07928 (table test-table [id=4e5789f17781493a91552b9d497c7bc1]) successfully deleted
W20260810 01:43:34.895772 1143 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:36779 (error 108)
I20260810 01:43:34.897257 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 1503
I20260810 01:43:34.897281 1910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:43:34.897001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:36779 (local address 127.0.0.1:47444)
0810 01:43:34.897128 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 01:43:34.897203 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:36779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 01:43:34.921849 1143 catalog_manager.cc:4584] TS 73331cd7c06b4ff6928de0cd20e8450e (127.16.58.65:36779): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a24f88792f444121bb1a40c6c6d07928: Network error: Client connection negotiation failed: client connection to 127.16.58.65:36779: connect: Connection refused (error 111)
I20260810 01:43:34.929778 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 1694
I20260810 01:43:34.963690 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 1121
I20260810 01:43:34.973366 16617 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 01:43:35.316820 16617 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 01:43:35.316952 16617 mini_ranger.cc:66] Stopping Ranger...
I20260810 01:43:35.670480 16617 mini_ranger.cc:68] Stopped Ranger
2026-08-10 01:43:35.670 UTC [498] LOG: received smart shutdown request
2026-08-10 01:43:35.675 UTC [498] LOG: background worker "logical replication launcher" (PID 511) exited with exit code 1
2026-08-10 01:43:35.675 UTC [503] LOG: shutting down
2026-08-10 01:43:35.819 UTC [498] LOG: database system is shut down
2026-08-10T01:43:35Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (43851 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:43:36 dist-test-slave-jlzn krb5kdc[1979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:43:36 dist-test-slave-jlzn krb5kdc[1979](info): set up 2 sockets
Aug 10 01:43:36 dist-test-slave-jlzn krb5kdc[1979](info): commencing operation
krb5kdc: starting...
W20260810 01:43:37.202160 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.001s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:43:37 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326217, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:43:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:43:37Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.16.58.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.16.58.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/rangeradmin_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/rangeradmin_127.16.58.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.16.58.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.16.58.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/rangerlookup_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/rangerlookup_127.16.58.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.58.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.16.58.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/HTTP_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/HTTP_127.16.58.84@KRBTEST.COM.keytab.
I20260810 01:43:37.359724 16617 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskouGL2L/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/postgres -l logfile start
2026-08-10 01:43:39.461 UTC [2024] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 01:43:39.461 UTC [2024] LOG: listening on IPv4 address "127.16.58.84", port 42483
2026-08-10 01:43:39.464 UTC [2024] LOG: listening on Unix socket "/tmp/.s.PGSQL.42483"
2026-08-10 01:43:39.483 UTC [2028] LOG: database system was shut down at 2026-08-10 01:43:38 UTC
2026-08-10 01:43:39.486 UTC [2024] LOG: database system is ready to accept connections
I20260810 01:43:40.533505 16617 mini_postgres.cc:96] Postgres bound to 42483
2026-08-10 01:43:40.540 UTC [2037] FATAL: database "slave" does not exist
127.16.58.84:42483 - accepting connections
I20260810 01:43:40.541205 16617 mini_ranger.cc:161] Starting Ranger...
I20260810 01:43:40.555716 16617 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 01:43:40.910653 16617 mini_ranger.cc:87] Created ranger Postgres database
I20260810 01:43:40.910727 16617 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-admin
2026-08-10 01:43:41,175 [I] DB FLAVOR :POSTGRES
2026-08-10 01:43:41,176 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 01:43:41,176 [I] Checking connection..
2026-08-10 01:43:41,176 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 01:43:41,408 [I] Checking connection passed.
2026-08-10 01:43:41,408 [I] --------- Verifying version history table ---------
2026-08-10 01:43:41,409 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:43:41,660 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 01:43:41,661 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:43:41,908 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 01:43:41,909 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 01:43:41,909 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 01:43:42.155 UTC [2139] WARNING: there is no transaction in progress
2026-08-10 01:43:42,162 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 01:43:42,163 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 01:43:42,396 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 01:43:42,397 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 01:43:42,397 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 01:43:42,622 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 01:43:42,858 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jlzn.c.gcp-upstream.internal','N') ;"
2026-08-10 01:43:43,103 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 01:43:43,355 [I] Table x_portal_user does not exist in database ranger
2026-08-10 01:43:43,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 01:43:43,604 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 01:43:43,605 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 01:43:43,855 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 01:43:44,093 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 01:43:44,094 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 01:43:44.927 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:44.941 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:44.954 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:44.967 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:44.980 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:44.995 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.055 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.061 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.073 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.081 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.090 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.101 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.109 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.114 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.119 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45.124 UTC [2307] WARNING: there is no transaction in progress
2026-08-10 01:43:45,616 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 01:43:45,616 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 01:43:45,858 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 01:43:45,858 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 01:43:46,102 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 01:43:46,103 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 01:43:46,353 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 01:43:46,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 01:43:46,595 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 01:43:46,822 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jlzn.c.gcp-upstream.internal';"
2026-08-10 01:43:47,065 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 01:43:47,065 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 01:43:47,313 [I] DB_PATCHES have already been applied
I20260810 01:43:47.319257 16617 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-admin:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskouGL2L/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 01:43:47.319319 16617 mini_ranger.cc:193] Using host: 127.16.58.84
I20260810 01:43:47.323383 16617 mini_ranger.cc:227] Ranger admin URL: http://127.16.58.84:45585
Aug 10, 2026 1:43:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 1:43:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 1:43:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 1:43:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 1:43:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 1:43:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 1:43:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 01:43:48.505751 16617 mini_ranger.cc:160] Time spent starting Ranger: real 7.965s user 0.000s sys 0.010s
Aug 10, 2026 1:44:06 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 1:44:06 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 1:44:06 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 1:44:06 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 1:44:07 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 01:44:08.136886 16617 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.16.58.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.16.58.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/rangerkms_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.16.58.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/rangerkms_127.16.58.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.16.58.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.16.58.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.16.58.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/HTTP_127.16.58.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.16.58.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/HTTP_127.16.58.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 01:44:08 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326248, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 01:44:08.211062 16617 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 01:44:08.219985 16617 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 01:44:08.850983 16617 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 01:44:08.851071 16617 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-kms
I20260810 01:44:08.851089 16617 mini_ranger_kms.cc:227] Using postgres at 127.16.58.84:42483
2026-08-10 01:44:09,006 [I] DB FLAVOR :POSTGRES
2026-08-10 01:44:09,006 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 01:44:09,006 [I] Checking connection
2026-08-10 01:44:09,007 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 01:44:09,239 [I] connection success
2026-08-10 01:44:09,239 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 01:44:09,239 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 01:44:09,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 01:44:09,460 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 01:44:09,461 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 01:44:09,461 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 01:44:09,461 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.16.58.84:42483/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 01:44:09,724 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 01:44:10.177004 16617 mini_ranger_kms.cc:310] Created kms service
I20260810 01:44:10.363224 16617 mini_ranger_kms.cc:326] Created kudu user
I20260810 01:44:10.403441 16617 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 01:44:10 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326248, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:10.749079 16617 mini_ranger_kms.cc:384] Added ranger policy
I20260810 01:44:10.749233 16617 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-kms:/tmp/dist-test-taskouGL2L/build/debug/bin/postgresql.jar:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskouGL2L/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 01:44:10.749253 16617 mini_ranger_kms.cc:240] Using host: 127.16.58.84
I20260810 01:44:10.753747 16617 mini_ranger_kms.cc:276] Ranger KMS PID: 2572
I20260810 01:44:10.753831 16617 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.16.58.84:44189
Aug 10, 2026 1:44:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 1:44:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 1:44:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 1:44:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 1:44:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 1:44:12 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 01:44:12 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786326252, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.58.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:13.213675 16617 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.003s user 0.016s sys 0.124s
I20260810 01:44:13.213807 16617 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 01:44:13.213872 16617 mini_ranger_kms.cc:401] 127.16.58.84:44189/kms/v1/keys
Aug 10 01:44:13 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326252, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.58.84@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
Aug 10 01:44:13 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326252, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.16.58.84@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
Aug 10 01:44:15 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:44:15.911983 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:44747
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:32783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:44747
--ranger_config_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:44189/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:16.018013 2644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:16.018254 2644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:16.018292 2644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:16.022186 2644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:16.022236 2644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:16.022254 2644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:16.022269 2644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:16.022282 2644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:16.027465 2644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
--ranger_kms_url=127.16.58.84:44189/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:44747
--ranger_config_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:44747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:16.028429 2644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:16.029356 2644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:16.037334 2655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:16.037397 2650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:16.037372 2651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:16.037545 2644 server_base.cc:1034] running on GCE node
I20260810 01:44:16.038300 2644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:16.039584 2644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:16.040781 2644 hybrid_clock.cc:648] HybridClock initialized: now 1786326256040752 us; error 35 us; skew 500 ppm
Aug 10 01:44:16 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326256, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:16.048164 2644 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:44:16.049206 2644 webserver.cc:460] Webserver started at http://127.16.58.126:45229/ using document root <none> and password file <none>
I20260810 01:44:16.049826 2644 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:16.049899 2644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:16.050128 2644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:44:16 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326256, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:16.103521 2644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "87b766ea74da49449dd0b3e3bff338ba"
format_stamp: "Formatted at 2026-08-10 01:44:16 on dist-test-slave-jlzn"
server_key: "f94587074383c44355b85d8cfa6552cd"
server_key_iv: "78e6fa25d59d4ab5a5d108b85567e5fa"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:16.104276 2644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "87b766ea74da49449dd0b3e3bff338ba"
format_stamp: "Formatted at 2026-08-10 01:44:16 on dist-test-slave-jlzn"
server_key: "f94587074383c44355b85d8cfa6552cd"
server_key_iv: "78e6fa25d59d4ab5a5d108b85567e5fa"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:16.109090 2644 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 01:44:16.126696 2663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:16.128095 2644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260810 01:44:16.128233 2644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "87b766ea74da49449dd0b3e3bff338ba"
format_stamp: "Formatted at 2026-08-10 01:44:16 on dist-test-slave-jlzn"
server_key: "f94587074383c44355b85d8cfa6552cd"
server_key_iv: "78e6fa25d59d4ab5a5d108b85567e5fa"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:16.128353 2644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:16.149070 2644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:16.151950 2644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:16.152143 2644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:16.158954 2644 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:44747
I20260810 01:44:16.159004 2735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:44747 every 8 connection(s)
I20260810 01:44:16.160033 2644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:44:16.163363 2736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:16.168279 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 2644
I20260810 01:44:16.168390 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:44:16.168645 16617 external_mini_cluster.cc:1428] Setting key d36fad2d69a9ee697f9277a6d04f78e7
I20260810 01:44:16.170521 2736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Bootstrap starting.
I20260810 01:44:16.173205 2736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:16.174042 2736 log.cc:824] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:16.176198 2736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: No bootstrap required, opened a new log
Aug 10 01:44:16 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326255, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:16.180413 2736 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } }
I20260810 01:44:16.180701 2736 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:16.180769 2736 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b766ea74da49449dd0b3e3bff338ba, State: Initialized, Role: FOLLOWER
I20260810 01:44:16.181241 2736 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } }
I20260810 01:44:16.181389 2736 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:44:16.181474 2736 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:44:16.181579 2736 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:16.181809 2742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:16.170023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48166 (local address 127.16.58.126:44747)
0810 01:44:16.170407 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:16.170422 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:16.170457 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:44:16.171073 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:16.171090 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:16.171402 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:16.171702 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:16.172526 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:16.173512 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:16.174388 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:16.174984 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:16.175127 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:16.177490 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:16.177495 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:16.177506 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:16.177533 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:16.178962 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:16.179363 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:16.179368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:16.179372 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:16.179474 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:16.179738 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:16.179741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:16.179743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:16.180154 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:16.180350 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:16.180611 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 01:44:16.180994 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":103,"threads_started":1}
I20260810 01:44:16.182612 2736 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } }
I20260810 01:44:16.182989 2736 leader_election.cc:302] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87b766ea74da49449dd0b3e3bff338ba; no voters:
I20260810 01:44:16.183333 2736 leader_election.cc:288] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:44:16.183418 2745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:44:16.183638 2745 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 1 LEADER]: Becoming Leader. State: Replica: 87b766ea74da49449dd0b3e3bff338ba, State: Running, Role: LEADER
I20260810 01:44:16.183979 2745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } }
I20260810 01:44:16.184579 2736 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:16.185110 2748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87b766ea74da49449dd0b3e3bff338ba. Latest consensus state: current_term: 1 leader_uuid: "87b766ea74da49449dd0b3e3bff338ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } } }
I20260810 01:44:16.185235 2748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:16.185860 2746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87b766ea74da49449dd0b3e3bff338ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } } }
I20260810 01:44:16.185949 2746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:16.186369 2752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:44:16.186707 2736 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 01:44:16.192276 2752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:44:16.199937 2752 catalog_manager.cc:1347] Generated new cluster ID: 4ecc415417644df4814e24b1f0671554
I20260810 01:44:16.200045 2752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:44:16.212749 2752 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:44:16.214753 2752 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:44:16.226082 2752 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Generated new TSK 0
I20260810 01:44:16.226970 2752 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:44:16.875608 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:44189/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44747
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:32783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:17.011852 2801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:17.012075 2801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:17.012133 2801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:17.016175 2801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:17.016238 2801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:17.016307 2801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:44:17.021389 2801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.16.58.84:44189/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:17.022341 2801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:17.023379 2801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:17.034590 2816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:17.034615 2819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:17.035001 2817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:17.035439 2801 server_base.cc:1034] running on GCE node
I20260810 01:44:17.035840 2801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:17.036430 2801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:17.037603 2801 hybrid_clock.cc:648] HybridClock initialized: now 1786326257037580 us; error 39 us; skew 500 ppm
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:17.040688 2801 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:44:17.041736 2801 webserver.cc:460] Webserver started at http://127.16.58.65:46669/ using document root <none> and password file <none>
I20260810 01:44:17.042448 2801 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:17.042550 2801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:17.042855 2801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:17.059042 2801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "66e585517cba433fba8ca08cee9fac37"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "0baf733b5e702190907f7d53051388ce"
server_key_iv: "8ddee75ba1d939144b8551644db49b3b"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:17.059744 2801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "66e585517cba433fba8ca08cee9fac37"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "0baf733b5e702190907f7d53051388ce"
server_key_iv: "8ddee75ba1d939144b8551644db49b3b"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:17.068310 2801 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260810 01:44:17.086784 2832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:17.088328 2801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:44:17.088442 2801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "66e585517cba433fba8ca08cee9fac37"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "0baf733b5e702190907f7d53051388ce"
server_key_iv: "8ddee75ba1d939144b8551644db49b3b"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:17.088559 2801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:17.145311 2801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:17.148937 2801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:17.149199 2801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:17.150007 2801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:17.151142 2801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:17.151257 2801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:17.151391 2801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:17.151484 2801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:17.170917 2801 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:46811
I20260810 01:44:17.176950 2801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:44:17.170975 3004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:46811 every 8 connection(s)
I20260810 01:44:17.186195 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 2801
I20260810 01:44:17.186321 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:44:17.186623 16617 external_mini_cluster.cc:1428] Setting key 21855911745a0bbaba5557792f39a2e4
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:17.197822 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:17.181734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:44747 (local address 127.16.58.65:40535)
0810 01:44:17.183139 (+ 1405us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:17.183197 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:17.184283 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:17.185145 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:17.185154 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:17.185489 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:17.186167 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:17.186189 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.187477 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.187481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:17.188934 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:17.188946 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.189697 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.189701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:17.189892 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:17.190548 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:17.190568 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:17.192351 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:17.194533 (+ 2182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:17.194539 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:17.194554 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:17.194953 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:17.195271 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:17.195274 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:17.195276 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:17.195450 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:17.195961 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:17.195968 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:17.196262 (+ 294us) client_negotiation.cc:769] Sending connection context
0810 01:44:17.196463 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 01:44:17.196795 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1172,"thread_start_us":146,"threads_started":1}
I20260810 01:44:17.198603 3008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:17.182890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:40535 (local address 127.16.58.126:44747)
0810 01:44:17.184710 (+ 1820us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:17.184718 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:17.184733 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:44:17.184775 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:17.184779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:17.184830 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:17.186321 (+ 1491us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:17.186432 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.187325 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.189073 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.189409 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.189521 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:17.192549 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:17.192552 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:17.192555 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:17.192581 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:17.194395 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:17.195069 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:17.195073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:17.195074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:17.195171 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:17.195573 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:17.195576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:17.195577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:17.195794 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:17.195906 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:17.198292 (+ 2386us) server_negotiation.cc:299] Negotiation successful
0810 01:44:17.198421 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1740,"thread_start_us":86,"threads_started":1}
I20260810 01:44:17.200160 3005 heartbeater.cc:347] Connected to a master server at 127.16.58.126:44747
I20260810 01:44:17.200393 3005 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:17.200934 3005 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
I20260810 01:44:17.202662 2687 ts_manager.cc:194] Registered new tserver with Master: 66e585517cba433fba8ca08cee9fac37 (127.16.58.65:46811)
I20260810 01:44:17.204202 2687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:40535
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:44:17.238572 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:44189/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44747
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:32783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 01:44:17.398125 3014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:17.398890 3014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:17.399060 3014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:17.404620 3014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:17.404778 3014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:17.404906 3014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:44:17.412365 3014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.16.58.84:44189/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:17.413789 3014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:17.415096 3014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:17.427649 3023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:17.428694 3029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:17.428982 3014 server_base.cc:1034] running on GCE node
W20260810 01:44:17.429912 3025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:17.430394 3014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:17.431098 3014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:17.432260 3014 hybrid_clock.cc:648] HybridClock initialized: now 1786326257432190 us; error 91 us; skew 500 ppm
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:17.435797 3014 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:44:17.436902 3014 webserver.cc:460] Webserver started at http://127.16.58.66:43889/ using document root <none> and password file <none>
I20260810 01:44:17.437621 3014 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:17.437760 3014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:17.438024 3014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:17.459766 3014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "1e33a6edba89418a8f26b6f12e204ab3"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "c7dff51739e66c4bb61fe1e159a51b21"
server_key_iv: "4d10bae6a3a8874991d8c83f6f2a61d4"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:17.462020 3014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "1e33a6edba89418a8f26b6f12e204ab3"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "c7dff51739e66c4bb61fe1e159a51b21"
server_key_iv: "4d10bae6a3a8874991d8c83f6f2a61d4"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:17.469238 3014 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260810 01:44:17.488443 3041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:17.490018 3014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 01:44:17.490155 3014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "1e33a6edba89418a8f26b6f12e204ab3"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "c7dff51739e66c4bb61fe1e159a51b21"
server_key_iv: "4d10bae6a3a8874991d8c83f6f2a61d4"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:17.490284 3014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:17.517576 3014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:17.520503 3014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:17.520674 3014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:17.521243 3014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:17.522104 3014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:17.522162 3014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:17.522215 3014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:17.522245 3014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:17.532202 3014 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:39271
I20260810 01:44:17.533108 3014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:44:17.533579 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 3014
I20260810 01:44:17.533704 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:44:17.533993 16617 external_mini_cluster.cc:1428] Setting key edf5df3d13cc46619c35cbcb738f310b
I20260810 01:44:17.540186 3220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:39271 every 8 connection(s)
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
I20260810 01:44:17.575843 3008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:17.543197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:59807 (local address 127.16.58.126:44747)
0810 01:44:17.543312 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:17.543316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:17.544252 (+ 936us) server_negotiation.cc:407] Connection header received
0810 01:44:17.545501 (+ 1249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:17.545505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:17.545573 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:17.545634 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:17.547132 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.547972 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.549732 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.550085 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.550164 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:17.564471 (+ 14307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:17.564476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:17.564479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:17.564514 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:17.566278 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:17.569179 (+ 2901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:17.569182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:17.569184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:17.569279 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:17.569746 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:17.569750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:17.569752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:17.569995 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:17.570079 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:17.575471 (+ 5392us) server_negotiation.cc:299] Negotiation successful
0810 01:44:17.575631 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:44:17.577606 3225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:17.542148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:44747 (local address 127.16.58.66:59807)
0810 01:44:17.544095 (+ 1947us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:17.544161 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:17.545165 (+ 1004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:17.546069 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:17.546078 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:17.546433 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:17.546985 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:17.546999 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.548137 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.548140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:17.549574 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:17.549587 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.550371 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.550376 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:17.550574 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:17.551241 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:17.551261 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:17.563195 (+ 11934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:17.568649 (+ 5454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:17.568656 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:17.568675 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:17.569056 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:17.569405 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:17.569408 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:17.569410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:17.569610 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:17.574716 (+ 5106us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:17.574724 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:17.575116 (+ 392us) client_negotiation.cc:769] Sending connection context
0810 01:44:17.576106 (+ 990us) client_negotiation.cc:240] Negotiation successful
0810 01:44:17.576506 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1731,"thread_start_us":130,"threads_started":1}
I20260810 01:44:17.579233 3221 heartbeater.cc:347] Connected to a master server at 127.16.58.126:44747
I20260810 01:44:17.579492 3221 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:17.580124 3221 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
I20260810 01:44:17.581475 2687 ts_manager.cc:194] Registered new tserver with Master: 1e33a6edba89418a8f26b6f12e204ab3 (127.16.58.66:39271)
I20260810 01:44:17.582243 2687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:59807
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:44:17.596009 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:44189/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44747
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:32783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
W20260810 01:44:17.753647 3228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:17.753964 3228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:17.754020 3228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:17.759850 3228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:17.759914 3228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:17.759992 3228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:44:17.767298 3228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.16.58.84:44189/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:44747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:17.768502 3228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:17.769726 3228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:17.781379 3236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:17.781406 3233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:17.781497 3238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:17.782446 3228 server_base.cc:1034] running on GCE node
I20260810 01:44:17.782888 3228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:17.783627 3228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:17.784825 3228 hybrid_clock.cc:648] HybridClock initialized: now 1786326257784765 us; error 96 us; skew 500 ppm
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:17.787699 3228 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:44:17.788533 3228 webserver.cc:460] Webserver started at http://127.16.58.67:36031/ using document root <none> and password file <none>
I20260810 01:44:17.789060 3228 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:17.789129 3228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:17.789347 3228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:17.810842 3228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "9bb63eff47a941bc93449d2da07af595"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "3b0b3e60e164ff94df447e2285b732c8"
server_key_iv: "9b4aa6971401cb32114eae9f1bba7e06"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:17.813030 3228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "9bb63eff47a941bc93449d2da07af595"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "3b0b3e60e164ff94df447e2285b732c8"
server_key_iv: "9b4aa6971401cb32114eae9f1bba7e06"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:17.820406 3228 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.001s
I20260810 01:44:17.839382 3246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:17.841071 3228 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260810 01:44:17.841212 3228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "9bb63eff47a941bc93449d2da07af595"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "3b0b3e60e164ff94df447e2285b732c8"
server_key_iv: "9b4aa6971401cb32114eae9f1bba7e06"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:17.841334 3228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:17.867717 3228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:17.871070 3228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:17.871304 3228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:17.871995 3228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:17.873011 3228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:17.873116 3228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:17.873220 3228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:17.873284 3228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:17.883569 3228 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:44041
I20260810 01:44:17.884858 3228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:44:17.887102 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 3228
I20260810 01:44:17.887233 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:44:17.887526 16617 external_mini_cluster.cc:1428] Setting key 1121144acb4ed5bef56e5408af9d18e2
I20260810 01:44:17.893420 3413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:44041 every 8 connection(s)
Aug 10 01:44:17 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326257, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:17.909935 3008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:17.896109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:42395 (local address 127.16.58.126:44747)
0810 01:44:17.896238 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:17.896243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:17.897366 (+ 1123us) server_negotiation.cc:407] Connection header received
0810 01:44:17.898584 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:17.898587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:17.898639 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:17.898720 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:17.900197 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.901008 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.902697 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.903048 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.903157 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:17.906002 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:17.906007 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:17.906010 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:17.906038 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:17.907669 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:17.908272 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:17.908275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:17.908277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:17.908370 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:17.908767 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:17.908770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:17.908772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:17.908995 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:17.909091 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:17.909662 (+ 571us) server_negotiation.cc:299] Negotiation successful
0810 01:44:17.909777 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:44:17.910899 3421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:17.896656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:44747 (local address 127.16.58.67:42395)
0810 01:44:17.897208 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:17.897268 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:17.898339 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:17.898919 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:17.898928 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:17.899295 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:17.900016 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:17.900039 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.901177 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.901180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:17.902562 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:17.902575 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:17.903201 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:17.903205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:17.903398 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:17.904087 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:17.904108 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:17.905826 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:17.907792 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:17.907798 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:17.907839 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:17.908174 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:17.908459 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:17.908462 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:17.908464 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:17.908633 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:17.909100 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:17.909106 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:17.909392 (+ 286us) client_negotiation.cc:769] Sending connection context
0810 01:44:17.909575 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 01:44:17.909897 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":132,"threads_started":1}
I20260810 01:44:17.912075 3415 heartbeater.cc:347] Connected to a master server at 127.16.58.126:44747
I20260810 01:44:17.912299 3415 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:17.912858 3415 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
I20260810 01:44:17.913921 2687 ts_manager.cc:194] Registered new tserver with Master: 9bb63eff47a941bc93449d2da07af595 (127.16.58.67:44041)
I20260810 01:44:17.914597 2687 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:42395
I20260810 01:44:17.924225 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:44:17.925026 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 2801
I20260810 01:44:17.970328 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 3014
I20260810 01:44:18.004042 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 3228
I20260810 01:44:18.035221 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 2644
I20260810 01:44:18.049643 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:44747
--webserver_interface=127.16.58.126
--webserver_port=45229
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:32783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:44747
--ranger_config_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:44189/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.58.84:44189/kms with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:18.156419 3423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:18.156646 3423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:18.156690 3423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:18.160521 3423 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:18.160568 3423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:18.160588 3423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:18.160616 3423 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:18.160650 3423 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:18.165766 3423 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.58.84:44189/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:44747
--ranger_config_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:44747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=45229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:18.166648 3423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:18.167532 3423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:18.175416 3430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:18.175387 3434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:18.175496 3423 server_base.cc:1034] running on GCE node
W20260810 01:44:18.175386 3431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:18.176158 3423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:18.177094 3423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:18.178256 3423 hybrid_clock.cc:648] HybridClock initialized: now 1786326258178241 us; error 31 us; skew 500 ppm
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:18.180831 3423 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:44:18.181597 3423 webserver.cc:460] Webserver started at http://127.16.58.126:45229/ using document root <none> and password file <none>
I20260810 01:44:18.182058 3423 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:18.182125 3423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:18.257568 3423 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.003s
I20260810 01:44:18.259738 3444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:18.261178 3423 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:44:18.261315 3423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "87b766ea74da49449dd0b3e3bff338ba"
format_stamp: "Formatted at 2026-08-10 01:44:16 on dist-test-slave-jlzn"
server_key: "f94587074383c44355b85d8cfa6552cd"
server_key_iv: "78e6fa25d59d4ab5a5d108b85567e5fa"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:18.261880 3423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:18.282811 3423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:18.285506 3423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:18.285670 3423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:18.292469 3423 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:44747
I20260810 01:44:18.292491 3530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:44747 every 8 connection(s)
I20260810 01:44:18.293438 3423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:44:18.297079 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 3423
I20260810 01:44:18.297473 3531 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:44:18.297470 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:44189/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:46811
--local_ip_for_outbound_sockets=127.16.58.65
--tserver_master_addrs=127.16.58.126:44747
--webserver_port=46669
--webserver_interface=127.16.58.65
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:32783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.58.84:44189/kms with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:44:18.299032 3531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Bootstrap starting.
I20260810 01:44:18.314347 3531 log.cc:824] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:18.320699 3531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:44:18.321014 3531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Bootstrap complete.
I20260810 01:44:18.324810 3531 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } }
I20260810 01:44:18.325186 3531 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b766ea74da49449dd0b3e3bff338ba, State: Initialized, Role: FOLLOWER
I20260810 01:44:18.325613 3531 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } }
I20260810 01:44:18.325739 3531 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:44:18.325805 3531 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:44:18.325894 3531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:44:18.327600 3531 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } }
I20260810 01:44:18.327934 3531 leader_election.cc:302] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87b766ea74da49449dd0b3e3bff338ba; no voters:
I20260810 01:44:18.328208 3531 leader_election.cc:288] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 01:44:18.328348 3535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:44:18.328588 3535 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [term 2 LEADER]: Becoming Leader. State: Replica: 87b766ea74da49449dd0b3e3bff338ba, State: Running, Role: LEADER
I20260810 01:44:18.328917 3535 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } }
I20260810 01:44:18.329313 3531 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:18.330296 3537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87b766ea74da49449dd0b3e3bff338ba. Latest consensus state: current_term: 2 leader_uuid: "87b766ea74da49449dd0b3e3bff338ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } } }
I20260810 01:44:18.330415 3537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:18.330659 3536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "87b766ea74da49449dd0b3e3bff338ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b766ea74da49449dd0b3e3bff338ba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44747 } } }
I20260810 01:44:18.330739 3536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:18.330772 3547 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:44:18.334062 3547 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:44:18.334601 3531 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 01:44:18.334676 3547 catalog_manager.cc:1259] Loaded cluster ID: 4ecc415417644df4814e24b1f0671554
I20260810 01:44:18.334724 3547 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:44:18.339464 3547 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:44:18.340853 3547 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Loaded TSK: 0
I20260810 01:44:18.342257 3547 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:44:18.412220 3533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:18.412441 3533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:18.412497 3533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:18.417516 3533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:18.417652 3533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:18.417790 3533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:44:18.423712 3533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.58.84:44189/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:46811
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=46669
--tserver_master_addrs=127.16.58.126:44747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:18.424681 3533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:18.425622 3533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:18.435493 3582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:18.435506 3579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:18.435796 3580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:18.436144 3533 server_base.cc:1034] running on GCE node
I20260810 01:44:18.436499 3533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:18.437076 3533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:18.438248 3533 hybrid_clock.cc:648] HybridClock initialized: now 1786326258438226 us; error 35 us; skew 500 ppm
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:18.440800 3533 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:44:18.441618 3533 webserver.cc:460] Webserver started at http://127.16.58.65:46669/ using document root <none> and password file <none>
I20260810 01:44:18.442128 3533 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:18.442281 3533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:18.466064 3533 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.001s
I20260810 01:44:18.468657 3595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:18.469993 3533 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260810 01:44:18.470113 3533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "66e585517cba433fba8ca08cee9fac37"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "0baf733b5e702190907f7d53051388ce"
server_key_iv: "8ddee75ba1d939144b8551644db49b3b"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:18.470712 3533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:18.490890 3533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:18.494076 3533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:18.494308 3533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:18.495015 3533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:18.496109 3533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:18.496181 3533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:18.496274 3533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:18.496351 3533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:18.506345 3533 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:46811
I20260810 01:44:18.507355 3533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:44:18.512485 3761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:46811 every 8 connection(s)
I20260810 01:44:18.516595 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 3533
I20260810 01:44:18.517071 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:44189/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:39271
--local_ip_for_outbound_sockets=127.16.58.66
--tserver_master_addrs=127.16.58.126:44747
--webserver_port=43889
--webserver_interface=127.16.58.66
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:32783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.58.84:44189/kms with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:18.540742 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:18.514523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:44747 (local address 127.16.58.65:59295)
0810 01:44:18.515289 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:18.515341 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:18.516274 (+ 933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:18.518082 (+ 1808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:18.518090 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:18.518406 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:18.519012 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:18.519152 (+ 140us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:18.520834 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:18.520837 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:18.522003 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:18.522013 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:18.522728 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:18.522732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:18.522899 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:18.528023 (+ 5124us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:18.528045 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:18.531713 (+ 3668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:18.537197 (+ 5484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:18.537203 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:18.537217 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:18.537560 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:18.537961 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:18.537964 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:18.537966 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:18.538136 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:18.538897 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:18.538903 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:18.539186 (+ 283us) client_negotiation.cc:769] Sending connection context
0810 01:44:18.539387 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 01:44:18.539723 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":130,"threads_started":1}
I20260810 01:44:18.542465 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:18.514404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:59295 (local address 127.16.58.126:44747)
0810 01:44:18.514999 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:18.515021 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:18.516597 (+ 1576us) server_negotiation.cc:407] Connection header received
0810 01:44:18.516892 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:18.516905 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:18.517301 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:18.517614 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:18.519333 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:18.520679 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:18.522125 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:18.522573 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:18.522721 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:18.534846 (+ 12125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:18.534853 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:18.534869 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:18.534904 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:18.537056 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:18.537701 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:18.537707 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:18.537712 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:18.537849 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:18.538250 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:18.538254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:18.538256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:18.538718 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:18.538842 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:18.541275 (+ 2433us) server_negotiation.cc:299] Negotiation successful
0810 01:44:18.541590 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":115,"threads_started":1}
I20260810 01:44:18.545950 3762 heartbeater.cc:347] Connected to a master server at 127.16.58.126:44747
I20260810 01:44:18.546195 3762 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:18.546778 3762 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
W20260810 01:44:18.549042 3762 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:44747 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 01:44:18.549175 3762 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:18.549343 3762 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
I20260810 01:44:18.550212 3762 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:18.550383 3762 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
W20260810 01:44:18.551143 3762 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:44:18.658430 3768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:18.658794 3768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:18.658890 3768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:18.663354 3768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:18.663411 3768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:18.663487 3768 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:44:18.668694 3768 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.58.84:44189/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:39271
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=43889
--tserver_master_addrs=127.16.58.126:44747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:18.669651 3768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:18.670645 3768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:18.679952 3778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:18.680081 3776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:18.680074 3775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:18.680568 3768 server_base.cc:1034] running on GCE node
I20260810 01:44:18.680925 3768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:18.681631 3768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:18.684901 3768 hybrid_clock.cc:648] HybridClock initialized: now 1786326258684873 us; error 33 us; skew 500 ppm
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:18.687613 3768 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:44:18.688490 3768 webserver.cc:460] Webserver started at http://127.16.58.66:43889/ using document root <none> and password file <none>
I20260810 01:44:18.689028 3768 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:18.689110 3768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:18.704438 3768 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:44:18.708631 3788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:18.709997 3768 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260810 01:44:18.710119 3768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "1e33a6edba89418a8f26b6f12e204ab3"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "c7dff51739e66c4bb61fe1e159a51b21"
server_key_iv: "4d10bae6a3a8874991d8c83f6f2a61d4"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:18.710795 3768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:18.742349 3768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:18.745503 3768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:18.745702 3768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:18.746382 3768 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:18.747380 3768 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:18.747495 3768 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:18.747598 3768 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:18.747665 3768 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:18.757695 3768 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:39271
I20260810 01:44:18.759052 3768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:44:18.760193 3967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:39271 every 8 connection(s)
I20260810 01:44:18.761240 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 3768
I20260810 01:44:18.761710 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.16.58.84:44189/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:44041
--local_ip_for_outbound_sockets=127.16.58.67
--tserver_master_addrs=127.16.58.126:44747
--webserver_port=36031
--webserver_interface=127.16.58.67
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:32783
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.16.58.84:44189/kms with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:18.796291 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:18.762908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:39669 (local address 127.16.58.126:44747)
0810 01:44:18.763042 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:18.763046 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:18.772269 (+ 9223us) server_negotiation.cc:407] Connection header received
0810 01:44:18.776186 (+ 3917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:18.776190 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:18.776256 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:18.776313 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:18.777980 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:18.778824 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:18.780555 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:18.780926 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:18.781004 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:18.785563 (+ 4559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:18.785568 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:18.785571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:18.785599 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:18.787234 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:18.794496 (+ 7262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:18.794500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:18.794501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:18.794614 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:18.795016 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:18.795019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:18.795021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:18.795250 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:18.795329 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:18.795974 (+ 645us) server_negotiation.cc:299] Negotiation successful
0810 01:44:18.796121 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:44:18.797101 3975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:18.763385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:44747 (local address 127.16.58.66:39669)
0810 01:44:18.772074 (+ 8689us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:18.772142 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:18.775912 (+ 3770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:18.776755 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:18.776765 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:18.777112 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:18.777800 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:18.777820 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:18.778985 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:18.778988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:18.780404 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:18.780416 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:18.781207 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:18.781211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:18.781398 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:18.782074 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:18.782095 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:18.784416 (+ 2321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:18.794005 (+ 9589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:18.794012 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:18.794026 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:18.794373 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:18.794731 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:18.794734 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:18.794736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:18.794907 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:18.795395 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:18.795401 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:18.795699 (+ 298us) client_negotiation.cc:769] Sending connection context
0810 01:44:18.795909 (+ 210us) client_negotiation.cc:240] Negotiation successful
0810 01:44:18.796195 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6576,"thread_start_us":143,"threads_started":1}
I20260810 01:44:18.798308 3968 heartbeater.cc:347] Connected to a master server at 127.16.58.126:44747
I20260810 01:44:18.798553 3968 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:18.799131 3968 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
W20260810 01:44:18.800733 3968 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:44747 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 01:44:18.800860 3968 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:18.801043 3968 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
I20260810 01:44:18.801883 3968 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:18.802058 3968 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
W20260810 01:44:18.802834 3968 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:44:18.923868 3973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:18.924198 3973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:18.924328 3973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:18.930052 3973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:18.930161 3973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:18.930255 3973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:44:18.937670 3973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:32783
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.16.58.84:44189/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:44041
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=36031
--tserver_master_addrs=127.16.58.126:44747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:18.939055 3973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:18.940390 3973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:18.951897 3983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:18.951889 3987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:18.952041 3989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:18.952518 3973 server_base.cc:1034] running on GCE node
I20260810 01:44:18.952976 3973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:18.953796 3973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:18.955004 3973 hybrid_clock.cc:648] HybridClock initialized: now 1786326258954979 us; error 34 us; skew 500 ppm
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:18.958173 3973 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:44:18.958993 3973 webserver.cc:460] Webserver started at http://127.16.58.67:36031/ using document root <none> and password file <none>
I20260810 01:44:18.959689 3973 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:18.959782 3973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 01:44:18 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:18.978183 3973 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:44:18.981163 3999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:18.982653 3973 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:44:18.982779 3973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "9bb63eff47a941bc93449d2da07af595"
format_stamp: "Formatted at 2026-08-10 01:44:17 on dist-test-slave-jlzn"
server_key: "3b0b3e60e164ff94df447e2285b732c8"
server_key_iv: "9b4aa6971401cb32114eae9f1bba7e06"
server_key_version: "kuduclusterkey@0"
I20260810 01:44:18.983467 3973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:18.998616 3973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:19.002063 3973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:19.002300 3973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:19.003027 3973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:19.004112 3973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:19.004210 3973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:19.004307 3973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:19.004366 3973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:19.015564 3973 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:44041
I20260810 01:44:19.017132 3973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:44:19.020402 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 3973
I20260810 01:44:19.018973 4170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:44041 every 8 connection(s)
Aug 10 01:44:19 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326258, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:19.036976 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:19.022308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:47311 (local address 127.16.58.126:44747)
0810 01:44:19.022453 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:19.022458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:19.023275 (+ 817us) server_negotiation.cc:407] Connection header received
0810 01:44:19.024531 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:19.024535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:19.024593 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:19.024653 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:19.026260 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:19.027088 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:19.028806 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:19.029139 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:19.029222 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:19.032580 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:19.032584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:19.032587 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:19.032614 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:19.034541 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:19.035140 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:19.035144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:19.035146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:19.035233 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:19.035648 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:19.035651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:19.035653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:19.035943 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:19.036029 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:19.036681 (+ 652us) server_negotiation.cc:299] Negotiation successful
0810 01:44:19.036804 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66,"spinlock_wait_cycles":768}
I20260810 01:44:19.037271 4180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:19.022321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48172 (local address 127.16.58.126:44747)
0810 01:44:19.027991 (+ 5670us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:19.027995 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:19.028392 (+ 397us) server_negotiation.cc:407] Connection header received
0810 01:44:19.028431 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:19.028434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:19.028477 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:19.028551 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:19.029554 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:19.030755 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:19.032011 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:19.032346 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:19.032434 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:19.034441 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:19.034444 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:19.034446 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:19.034486 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:19.035733 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:19.036140 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:19.036143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:19.036144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:19.036219 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:19.036477 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:19.036480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:19.036481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:19.036637 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:19.036836 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:19.036978 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 01:44:19.037087 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":5596,"spinlock_wait_cycles":6912,"thread_start_us":88,"threads_started":1}
I20260810 01:44:19.038722 4177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:19.021167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:44747 (local address 127.16.58.67:47311)
0810 01:44:19.023125 (+ 1958us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:19.023180 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:19.024275 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:19.025064 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:19.025073 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:19.025412 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:19.026083 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:19.026106 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:19.027250 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:19.027253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:19.028663 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:19.028675 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:19.029419 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:19.029423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:19.029645 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:19.030247 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:19.030269 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:19.032373 (+ 2104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:19.034674 (+ 2301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:19.034680 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:19.034693 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:19.035024 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:19.035343 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:19.035346 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:19.035349 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:19.035533 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:19.036100 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:19.036106 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:19.036387 (+ 281us) client_negotiation.cc:769] Sending connection context
0810 01:44:19.037459 (+ 1072us) client_negotiation.cc:240] Negotiation successful
0810 01:44:19.037786 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1746,"thread_start_us":143,"threads_started":1}
I20260810 01:44:19.039781 4171 heartbeater.cc:347] Connected to a master server at 127.16.58.126:44747
I20260810 01:44:19.040014 4171 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:19.040455 4171 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
W20260810 01:44:19.041925 4171 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:44747 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 01:44:19.042038 4171 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:19.042196 4171 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
I20260810 01:44:19.043130 4171 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:19.043282 4171 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
W20260810 01:44:19.044057 4171 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 01:44:19 dist-test-slave-jlzn krb5kdc[1979](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786326259, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:19.551362 3762 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:19.551661 3762 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
I20260810 01:44:19.552708 3470 ts_manager.cc:194] Registered new tserver with Master: 66e585517cba433fba8ca08cee9fac37 (127.16.58.65:46811)
I20260810 01:44:19.554454 3470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:59295
Aug 10 01:44:19 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326259, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:19.803054 3968 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:19.803335 3968 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
I20260810 01:44:19.804059 3470 ts_manager.cc:194] Registered new tserver with Master: 1e33a6edba89418a8f26b6f12e204ab3 (127.16.58.66:39271)
I20260810 01:44:19.804795 3470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:39669
Aug 10 01:44:20 dist-test-slave-jlzn krb5kdc[1979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326259, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for HTTP/127.16.58.84@KRBTEST.COM
I20260810 01:44:20.044250 4171 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:20.044543 4171 heartbeater.cc:511] Master 127.16.58.126:44747 requested a full tablet report, sending...
I20260810 01:44:20.045220 3470 ts_manager.cc:194] Registered new tserver with Master: 9bb63eff47a941bc93449d2da07af595 (127.16.58.67:44041)
I20260810 01:44:20.045951 3470 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:47311
I20260810 01:44:20.052786 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:44:20.065377 4214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.054474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48180 (local address 127.16.58.126:44747)
0810 01:44:20.055195 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:20.055200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:20.055214 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:44:20.055250 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:20.055253 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:20.055297 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:20.055387 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:20.056483 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.057271 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.058380 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.058710 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.058800 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.060511 (+ 1711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:20.060516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:20.060518 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:20.060545 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:20.062328 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:20.062790 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:20.062793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:20.062795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:20.062880 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:20.063229 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:20.063233 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:20.063234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:20.063466 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:20.063604 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:20.065071 (+ 1467us) server_negotiation.cc:299] Negotiation successful
0810 01:44:20.065204 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":92,"threads_started":1}
I20260810 01:44:20.068907 3470 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48180:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:44:20.072255 3470 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:44:20.092777 4231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.082832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:46811 (local address 127.0.0.1:59434)
0810 01:44:20.086854 (+ 4022us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:20.086889 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:20.086982 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:20.087747 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:20.087753 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:20.087775 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:20.087928 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.087936 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.089489 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.089492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.090889 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.090900 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.092258 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.092261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.092361 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.092404 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 01:44:20.092497 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 01:44:20.092606 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3894,"mutex_wait_us":3,"thread_start_us":98,"threads_started":1}
I20260810 01:44:20.093230 4226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.082941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59434 (local address 127.16.58.65:46811)
0810 01:44:20.087368 (+ 4427us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:20.087372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:20.087391 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:44:20.087452 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:20.087455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:20.087603 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:20.087737 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:20.088063 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.089374 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.091027 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.091958 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.092058 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.092198 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:20.092959 (+ 761us) server_negotiation.cc:299] Negotiation successful
0810 01:44:20.093055 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4349,"thread_start_us":126,"threads_started":1}
I20260810 01:44:20.094409 4233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.084966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:44041 (local address 127.0.0.1:56576)
0810 01:44:20.088861 (+ 3895us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:20.088875 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:20.088960 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:20.089780 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:20.089783 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:20.089798 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:20.089867 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.089872 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.091188 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.091191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.092325 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.092334 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.093999 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.094002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.094100 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.094123 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:44:20.094208 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 01:44:20.094277 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3835,"thread_start_us":1473,"threads_started":1}
I20260810 01:44:20.094702 4232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.084599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37230 (local address 127.16.58.66:39271)
0810 01:44:20.087206 (+ 2607us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:20.087211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:20.088203 (+ 992us) server_negotiation.cc:407] Connection header received
0810 01:44:20.088287 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:20.088292 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:20.088465 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:20.088640 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:20.089775 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.090940 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.092408 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.093862 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.093957 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.094094 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:20.094484 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 01:44:20.094576 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2510,"thread_start_us":69,"threads_started":1}
I20260810 01:44:20.095027 4225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.084191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:39271 (local address 127.0.0.1:37230)
0810 01:44:20.088000 (+ 3809us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:20.088013 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:20.088094 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:20.089563 (+ 1469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:20.089566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:20.089583 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:20.089671 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.089676 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.091079 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.091083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.092275 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.092287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.094155 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.094158 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.094242 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.094264 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:44:20.094326 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 01:44:20.094390 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3750,"mutex_wait_us":3,"thread_start_us":92,"threads_started":1}
I20260810 01:44:20.096076 4235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.086251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56576 (local address 127.16.58.67:44041)
0810 01:44:20.086487 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:20.086494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:20.089048 (+ 2554us) server_negotiation.cc:407] Connection header received
0810 01:44:20.089125 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:20.089140 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:20.089297 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:20.089429 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:20.089982 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.091064 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.092452 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.093720 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.093817 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.093939 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:20.095846 (+ 1907us) server_negotiation.cc:299] Negotiation successful
0810 01:44:20.095944 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":62,"threads_started":1}
I20260810 01:44:20.096642 3654 tablet_service.cc:1467] Processing CreateTablet for tablet 51d4df99759749efaeb9587ea8d1059a (DEFAULT_TABLE table=test-table [id=658d1f6a737a4c079ea911b656697f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:20.097808 3654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d4df99759749efaeb9587ea8d1059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:20.097693 3855 tablet_service.cc:1467] Processing CreateTablet for tablet 51d4df99759749efaeb9587ea8d1059a (DEFAULT_TABLE table=test-table [id=658d1f6a737a4c079ea911b656697f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:20.098634 3855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d4df99759749efaeb9587ea8d1059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:20.098754 4048 tablet_service.cc:1467] Processing CreateTablet for tablet 51d4df99759749efaeb9587ea8d1059a (DEFAULT_TABLE table=test-table [id=658d1f6a737a4c079ea911b656697f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:20.099648 4048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d4df99759749efaeb9587ea8d1059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:20.107384 4238 tablet_bootstrap.cc:492] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37: Bootstrap starting.
I20260810 01:44:20.107831 4236 tablet_bootstrap.cc:492] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: Bootstrap starting.
I20260810 01:44:20.109965 4236 tablet_bootstrap.cc:654] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:20.110225 4238 tablet_bootstrap.cc:654] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:20.111441 4238 log.cc:824] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:20.112118 4242 tablet_bootstrap.cc:492] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: Bootstrap starting.
I20260810 01:44:20.114118 4242 tablet_bootstrap.cc:654] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:20.114297 4238 tablet_bootstrap.cc:492] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37: No bootstrap required, opened a new log
I20260810 01:44:20.114482 4238 ts_tablet_manager.cc:1397] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260810 01:44:20.114897 4242 log.cc:824] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:20.118095 4242 tablet_bootstrap.cc:492] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: No bootstrap required, opened a new log
I20260810 01:44:20.118322 4242 ts_tablet_manager.cc:1397] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:44:20.122839 4236 log.cc:824] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:20.123584 4242 raft_consensus.cc:348] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } }
I20260810 01:44:20.123895 4242 raft_consensus.cc:374] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:20.123960 4238 raft_consensus.cc:348] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } }
I20260810 01:44:20.124197 4242 raft_consensus.cc:729] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bb63eff47a941bc93449d2da07af595, State: Initialized, Role: FOLLOWER
I20260810 01:44:20.124749 4242 consensus_queue.cc:260] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } }
I20260810 01:44:20.125860 4242 ts_tablet_manager.cc:1428] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 01:44:20.126260 4171 heartbeater.cc:503] Master 127.16.58.126:44747 was elected leader, sending a full tablet report...
I20260810 01:44:20.129773 4238 raft_consensus.cc:374] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:20.130841 4238 raft_consensus.cc:729] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e585517cba433fba8ca08cee9fac37, State: Initialized, Role: FOLLOWER
I20260810 01:44:20.131405 4238 consensus_queue.cc:260] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } }
I20260810 01:44:20.132740 4238 ts_tablet_manager.cc:1428] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260810 01:44:20.133737 4236 tablet_bootstrap.cc:492] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: No bootstrap required, opened a new log
I20260810 01:44:20.133994 4236 ts_tablet_manager.cc:1397] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20260810 01:44:20.135445 3762 heartbeater.cc:503] Master 127.16.58.126:44747 was elected leader, sending a full tablet report...
I20260810 01:44:20.140208 4236 raft_consensus.cc:348] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } }
I20260810 01:44:20.140970 4236 raft_consensus.cc:374] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:20.141052 4236 raft_consensus.cc:729] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e33a6edba89418a8f26b6f12e204ab3, State: Initialized, Role: FOLLOWER
I20260810 01:44:20.141492 4236 consensus_queue.cc:260] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } }
I20260810 01:44:20.142768 4236 ts_tablet_manager.cc:1428] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260810 01:44:20.143210 3968 heartbeater.cc:503] Master 127.16.58.126:44747 was elected leader, sending a full tablet report...
I20260810 01:44:20.254129 4250 raft_consensus.cc:482] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:44:20.254410 4250 raft_consensus.cc:504] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } }
I20260810 01:44:20.255929 4250 leader_election.cc:288] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e585517cba433fba8ca08cee9fac37 (127.16.58.65:46811), 9bb63eff47a941bc93449d2da07af595 (127.16.58.67:44041)
W20260810 01:44:20.263298 3971 tablet.cc:2369] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:44:20.264604 4226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.258107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:51201 (local address 127.16.58.65:46811)
0810 01:44:20.258244 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:20.258250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:20.258798 (+ 548us) server_negotiation.cc:407] Connection header received
0810 01:44:20.259007 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:20.259010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:20.259057 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:20.259111 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:20.259869 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.260494 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.262312 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.262904 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.262993 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.263051 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:20.264400 (+ 1349us) server_negotiation.cc:299] Negotiation successful
0810 01:44:20.264475 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 01:44:20.265482 3763 tablet.cc:2369] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:44:20.266002 4254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.256276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:46811 (local address 127.16.58.66:51201)
0810 01:44:20.258677 (+ 2401us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:20.258691 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:20.258885 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:20.259257 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:20.259260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:20.259276 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:20.259695 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.259705 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.260641 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.260644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.262158 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.262171 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.264089 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.264093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.264258 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.264283 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:44:20.265033 (+ 750us) client_negotiation.cc:240] Negotiation successful
0810 01:44:20.265116 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2334,"thread_start_us":899,"threads_started":1}
I20260810 01:44:20.266741 3676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d4df99759749efaeb9587ea8d1059a" candidate_uuid: "1e33a6edba89418a8f26b6f12e204ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e585517cba433fba8ca08cee9fac37" is_pre_election: true
I20260810 01:44:20.267041 3676 raft_consensus.cc:2454] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e33a6edba89418a8f26b6f12e204ab3 in term 0.
I20260810 01:44:20.267628 4235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.258332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:48647 (local address 127.16.58.67:44041)
0810 01:44:20.258458 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:20.258463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:20.262913 (+ 4450us) server_negotiation.cc:407] Connection header received
0810 01:44:20.263109 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:20.263112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:20.263161 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:20.263213 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:20.263863 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.264522 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.266373 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.266899 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.266988 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.267032 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:20.267426 (+ 394us) server_negotiation.cc:299] Negotiation successful
0810 01:44:20.267504 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:44:20.267622 3800 leader_election.cc:302] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e33a6edba89418a8f26b6f12e204ab3, 66e585517cba433fba8ca08cee9fac37; no voters:
I20260810 01:44:20.267933 4250 raft_consensus.cc:2781] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:44:20.268021 4250 raft_consensus.cc:482] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:44:20.268085 4250 raft_consensus.cc:3037] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:20.268298 4252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.257488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:44041 (local address 127.16.58.66:48647)
0810 01:44:20.262795 (+ 5307us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:20.262810 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:20.262987 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:20.263424 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:20.263426 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:20.263445 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:20.263702 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.263712 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.264661 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.264663 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.266230 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:20.266242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.267128 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.267131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:20.267288 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.267313 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:44:20.267970 (+ 657us) client_negotiation.cc:240] Negotiation successful
0810 01:44:20.268178 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5239,"thread_start_us":152,"threads_started":1}
I20260810 01:44:20.269026 4074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d4df99759749efaeb9587ea8d1059a" candidate_uuid: "1e33a6edba89418a8f26b6f12e204ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bb63eff47a941bc93449d2da07af595" is_pre_election: true
I20260810 01:44:20.269323 4074 raft_consensus.cc:2454] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e33a6edba89418a8f26b6f12e204ab3 in term 0.
I20260810 01:44:20.269798 4250 raft_consensus.cc:504] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } }
I20260810 01:44:20.270153 4250 leader_election.cc:288] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [CANDIDATE]: Term 1 election: Requested vote from peers 66e585517cba433fba8ca08cee9fac37 (127.16.58.65:46811), 9bb63eff47a941bc93449d2da07af595 (127.16.58.67:44041)
I20260810 01:44:20.270464 3676 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d4df99759749efaeb9587ea8d1059a" candidate_uuid: "1e33a6edba89418a8f26b6f12e204ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e585517cba433fba8ca08cee9fac37"
I20260810 01:44:20.270566 4074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d4df99759749efaeb9587ea8d1059a" candidate_uuid: "1e33a6edba89418a8f26b6f12e204ab3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bb63eff47a941bc93449d2da07af595"
I20260810 01:44:20.270582 3676 raft_consensus.cc:3037] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:20.270678 4074 raft_consensus.cc:3037] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:20.272092 3676 raft_consensus.cc:2454] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e33a6edba89418a8f26b6f12e204ab3 in term 1.
I20260810 01:44:20.272467 4074 raft_consensus.cc:2454] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e33a6edba89418a8f26b6f12e204ab3 in term 1.
I20260810 01:44:20.272454 3800 leader_election.cc:302] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e33a6edba89418a8f26b6f12e204ab3, 66e585517cba433fba8ca08cee9fac37; no voters:
I20260810 01:44:20.272650 4250 raft_consensus.cc:2781] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:44:20.272850 4250 raft_consensus.cc:686] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 1e33a6edba89418a8f26b6f12e204ab3, State: Running, Role: LEADER
I20260810 01:44:20.273183 4250 consensus_queue.cc:237] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } }
W20260810 01:44:20.273736 4173 tablet.cc:2369] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:44:20.277009 3469 catalog_manager.cc:5495] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e33a6edba89418a8f26b6f12e204ab3 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "1e33a6edba89418a8f26b6f12e204ab3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e33a6edba89418a8f26b6f12e204ab3" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39271 } health_report { overall_health: HEALTHY } } }
I20260810 01:44:20.290755 4232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.286000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37242 (local address 127.16.58.66:39271)
0810 01:44:20.286104 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:20.286107 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:20.286119 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:44:20.286182 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:20.286185 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:20.286237 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:20.286326 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:44:20.286675 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.287375 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.288659 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:20.288982 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:20.289092 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:20.289521 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:44:20.290018 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:44:20.290121 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:20.290559 (+ 438us) server_negotiation.cc:299] Negotiation successful
0810 01:44:20.290616 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:44:20.297279 4074 raft_consensus.cc:1261] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [term 1 FOLLOWER]: Refusing update from remote peer 1e33a6edba89418a8f26b6f12e204ab3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:20.297948 4250 consensus_queue.cc:1035] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bb63eff47a941bc93449d2da07af595" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:20.304145 3676 raft_consensus.cc:1261] T 51d4df99759749efaeb9587ea8d1059a P 66e585517cba433fba8ca08cee9fac37 [term 1 FOLLOWER]: Refusing update from remote peer 1e33a6edba89418a8f26b6f12e204ab3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:20.304726 4250 consensus_queue.cc:1035] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e585517cba433fba8ca08cee9fac37" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 46811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:20.313251 4260 mvcc.cc:205] Tried to move back new op lower bound from 7316792362169786368 to 7316792362082062336. Current Snapshot: MvccSnapshot[applied={T|T < 7316792362169786368}]
I20260810 01:44:20.313488 4261 mvcc.cc:205] Tried to move back new op lower bound from 7316792362169786368 to 7316792362082062336. Current Snapshot: MvccSnapshot[applied={T|T < 7316792362169786368}]
I20260810 01:44:20.322973 4263 mvcc.cc:205] Tried to move back new op lower bound from 7316792362169786368 to 7316792362082062336. Current Snapshot: MvccSnapshot[applied={T|T < 7316792362169786368}]
I20260810 01:44:20.332002 3469 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:44:20.332168 3469 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:44:20.334659 3469 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87b766ea74da49449dd0b3e3bff338ba: Sending DeleteTablet for 3 replicas of tablet 51d4df99759749efaeb9587ea8d1059a
I20260810 01:44:20.335958 3654 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d4df99759749efaeb9587ea8d1059a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:20 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:59434
I20260810 01:44:20.336580 4048 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d4df99759749efaeb9587ea8d1059a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:20 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:56576
I20260810 01:44:20.337198 3855 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d4df99759749efaeb9587ea8d1059a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:20 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:37230
I20260810 01:44:20.338340 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 3533
I20260810 01:44:20.347046 4278 tablet_replica.cc:330] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: stopping tablet replica
I20260810 01:44:20.347469 4278 raft_consensus.cc:2229] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:44:20.348035 4278 raft_consensus.cc:2258] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:20.352481 4277 tablet_replica.cc:330] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: stopping tablet replica
I20260810 01:44:20.359824 4277 raft_consensus.cc:2229] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:44:20.360232 4277 raft_consensus.cc:2258] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:20.361785 4277 ts_tablet_manager.cc:1905] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:44:20.362030 4278 ts_tablet_manager.cc:1905] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:44:20.364681 4277 ts_tablet_manager.cc:1918] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:44:20.364777 4278 ts_tablet_manager.cc:1918] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:44:20.364880 4278 log.cc:1196] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/51d4df99759749efaeb9587ea8d1059a
I20260810 01:44:20.364976 4277 log.cc:1196] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/51d4df99759749efaeb9587ea8d1059a
I20260810 01:44:20.365221 4278 ts_tablet_manager.cc:1939] T 51d4df99759749efaeb9587ea8d1059a P 1e33a6edba89418a8f26b6f12e204ab3: Deleting consensus metadata
I20260810 01:44:20.365437 4277 ts_tablet_manager.cc:1939] T 51d4df99759749efaeb9587ea8d1059a P 9bb63eff47a941bc93449d2da07af595: Deleting consensus metadata
I20260810 01:44:20.366443 3447 catalog_manager.cc:4841] TS 1e33a6edba89418a8f26b6f12e204ab3 (127.16.58.66:39271): tablet 51d4df99759749efaeb9587ea8d1059a (table test-table [id=658d1f6a737a4c079ea911b656697f78]) successfully deleted
I20260810 01:44:20.366699 3448 catalog_manager.cc:4841] TS 9bb63eff47a941bc93449d2da07af595 (127.16.58.67:44041): tablet 51d4df99759749efaeb9587ea8d1059a (table test-table [id=658d1f6a737a4c079ea911b656697f78]) successfully deleted
W20260810 01:44:20.367110 3448 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:46811 (error 108)
I20260810 01:44:20.368556 4225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:20.368287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:46811 (local address 127.0.0.1:59450)
0810 01:44:20.368397 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:20.368469 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:46811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 01:44:20.368539 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 3768
W20260810 01:44:20.377466 3448 catalog_manager.cc:4584] TS 66e585517cba433fba8ca08cee9fac37 (127.16.58.65:46811): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 51d4df99759749efaeb9587ea8d1059a: Network error: Client connection negotiation failed: client connection to 127.16.58.65:46811: connect: Connection refused (error 111)
I20260810 01:44:20.386554 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 3973
I20260810 01:44:20.395629 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 3423
I20260810 01:44:20.409554 16617 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 01:44:20.752902 16617 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 01:44:20.753012 16617 mini_ranger.cc:66] Stopping Ranger...
I20260810 01:44:21.088527 16617 mini_ranger.cc:68] Stopped Ranger
2026-08-10 01:44:21.088 UTC [2024] LOG: received smart shutdown request
2026-08-10 01:44:21.093 UTC [2024] LOG: background worker "logical replication launcher" (PID 2034) exited with exit code 1
2026-08-10 01:44:21.093 UTC [2029] LOG: shutting down
2026-08-10 01:44:21.223 UTC [2024] LOG: database system is shut down
2026-08-10T01:44:21Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (45328 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:44:21 dist-test-slave-jlzn krb5kdc[4304](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:44:21 dist-test-slave-jlzn krb5kdc[4304](info): set up 2 sockets
Aug 10 01:44:21 dist-test-slave-jlzn krb5kdc[4304](info): commencing operation
krb5kdc: starting...
W20260810 01:44:22.445542 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:44:22 dist-test-slave-jlzn krb5kdc[4304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:44:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:44:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:44:22.555560 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:40561
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:40561,127.16.58.125:37755,127.16.58.124:46027
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:22.661990 4322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:22.662215 4322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:22.662271 4322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:22.666488 4322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:22.666540 4322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:22.666568 4322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:22.666590 4322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:22.666618 4322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:22.671602 4322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:40561,127.16.58.125:37755,127.16.58.124:46027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:40561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:22.672508 4322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:22.673405 4322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:22.681318 4335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:22.681423 4322 server_base.cc:1034] running on GCE node
W20260810 01:44:22.681293 4336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:22.681339 4338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:22.682018 4322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:22.682973 4322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:22.684125 4322 hybrid_clock.cc:648] HybridClock initialized: now 1786326262684108 us; error 31 us; skew 500 ppm
Aug 10 01:44:22 dist-test-slave-jlzn krb5kdc[4304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:22.686645 4322 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:44:22.687454 4322 webserver.cc:460] Webserver started at http://127.16.58.126:35775/ using document root <none> and password file <none>
I20260810 01:44:22.687990 4322 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:22.688052 4322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:22.688220 4322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:22.690114 4322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "dd76d563a23d45a4a24c528b274c6b49"
format_stamp: "Formatted at 2026-08-10 01:44:22 on dist-test-slave-jlzn"
server_key: "e3925f86411b92e6d34621d1735647e4"
server_key_iv: "ff662a3962a668d9f68046d28806ae08"
server_key_version: "encryptionkey@0"
I20260810 01:44:22.690609 4322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "dd76d563a23d45a4a24c528b274c6b49"
format_stamp: "Formatted at 2026-08-10 01:44:22 on dist-test-slave-jlzn"
server_key: "e3925f86411b92e6d34621d1735647e4"
server_key_iv: "ff662a3962a668d9f68046d28806ae08"
server_key_version: "encryptionkey@0"
I20260810 01:44:22.693992 4322 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260810 01:44:22.696100 4350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:22.697193 4322 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260810 01:44:22.697291 4322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "dd76d563a23d45a4a24c528b274c6b49"
format_stamp: "Formatted at 2026-08-10 01:44:22 on dist-test-slave-jlzn"
server_key: "e3925f86411b92e6d34621d1735647e4"
server_key_iv: "ff662a3962a668d9f68046d28806ae08"
server_key_version: "encryptionkey@0"
I20260810 01:44:22.697369 4322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:22.718511 4322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:22.721333 4322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:22.721470 4322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:22.728060 4322 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:40561
I20260810 01:44:22.728080 4429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:40561 every 8 connection(s)
I20260810 01:44:22.728919 4322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:44:22.730415 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 4322
I20260810 01:44:22.730515 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:44:22.730772 16617 external_mini_cluster.cc:1428] Setting key c9b875ac6b31b8ccf96c0bfb597c6dce
I20260810 01:44:22.731582 4430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:22.735100 4430 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.58.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.125@KRBTEST.COM" created.
Aug 10 01:44:22 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:22.750411 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.737450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40561 (local address 127.0.0.1:39042)
0810 01:44:22.737957 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.738021 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:22.739032 (+ 1011us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:22.739756 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:22.739763 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:22.740133 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:22.740370 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:22.740383 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.741487 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.741490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:22.742453 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:22.742466 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.743263 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.743266 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:22.743369 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:22.744030 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:22.744047 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:22.745678 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:22.747743 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:22.747751 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:22.747758 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:22.748013 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:22.748377 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:22.748380 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:22.748382 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:22.748502 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:22.749182 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:22.749187 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:22.749305 (+ 118us) client_negotiation.cc:769] Sending connection context
0810 01:44:22.749427 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 01:44:22.749668 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":128,"threads_started":1}
I20260810 01:44:22.750417 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.737450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39042 (local address 127.16.58.126:40561)
0810 01:44:22.737965 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:22.737981 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:22.738130 (+ 149us) server_negotiation.cc:407] Connection header received
0810 01:44:22.739365 (+ 1235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:22.739369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:22.739558 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:22.739717 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:22.740493 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.741363 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.742572 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.743123 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.743283 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:22.745831 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:22.745838 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:22.745849 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:22.745874 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:22.747636 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:22.748118 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:22.748124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:22.748126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:22.748265 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:22.748603 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:22.748607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:22.748608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:22.749083 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:22.749220 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:22.749553 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 01:44:22.749764 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":402,"spinlock_wait_cycles":53120,"thread_start_us":152,"threads_started":1}
I20260810 01:44:22.752647 4430 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:44:22.753273 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.753040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:37755 (local address 127.0.0.1:51706)
0810 01:44:22.753143 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.753220 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 01:44:22.753451 4357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
I20260810 01:44:22.754298 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.754095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:37755 (local address 127.0.0.1:51718)
0810 01:44:22.754187 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.754239 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 01:44:22.754418 4430 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.125:37755: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab.
Entry for principal kudu/127.16.58.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab.
I20260810 01:44:22.757920 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.125:37755
--webserver_interface=127.16.58.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab
--principal=kudu/127.16.58.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:40561,127.16.58.125:37755,127.16.58.124:46027
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:44:22.803633 4430 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } attempt: 1
I20260810 01:44:22.804492 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.804142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:37755 (local address 127.0.0.1:51722)
0810 01:44:22.804317 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.804392 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 01:44:22.805230 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.804997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:37755 (local address 127.0.0.1:51724)
0810 01:44:22.805099 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.805154 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 01:44:22.805359 4430 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.125:37755: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
W20260810 01:44:22.871001 4442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:22.871371 4442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:22.871440 4442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 01:44:22.874790 4430 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } attempt: 2
W20260810 01:44:22.876061 4442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:22.876168 4442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
I20260810 01:44:22.876194 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.875383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:37755 (local address 127.0.0.1:51738)
0810 01:44:22.876018 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.876093 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":519}
W20260810 01:44:22.876230 4442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:22.876257 4442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:22.876277 4442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:22.877161 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.876889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:37755 (local address 127.0.0.1:51752)
0810 01:44:22.877027 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.877085 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 01:44:22.877362 4430 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.125:37755: Network error: Client connection negotiation failed: client connection to 127.16.58.125:37755: connect: Connection refused (error 111)
I20260810 01:44:22.884199 4442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:40561,127.16.58.125:37755,127.16.58.124:46027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab
--principal=kudu/127.16.58.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.125:37755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.58.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:22.885772 4442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:22.886931 4442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:22.895763 4454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:22.895742 4449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:22.895828 4450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:22.895998 4442 server_base.cc:1034] running on GCE node
I20260810 01:44:22.896734 4442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:22.898043 4442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:22.901283 4442 hybrid_clock.cc:648] HybridClock initialized: now 1786326262901186 us; error 104 us; skew 500 ppm
Aug 10 01:44:22 dist-test-slave-jlzn krb5kdc[4304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:22.904696 4442 init.cc:377] Logged in from keytab as kudu/127.16.58.125@KRBTEST.COM (short username kudu)
I20260810 01:44:22.905575 4442 webserver.cc:460] Webserver started at http://127.16.58.125:37883/ using document root <none> and password file <none>
I20260810 01:44:22.906132 4442 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:22.906204 4442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:22.906407 4442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:22.908471 4442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/data/instance:
uuid: "f3c4eecc390447c0ab41ca8cc0693c56"
format_stamp: "Formatted at 2026-08-10 01:44:22 on dist-test-slave-jlzn"
server_key: "ded4e52e77db25cb5b3f63f4aa5c3364"
server_key_iv: "04598b9af2ab2a1e3358e2b1e8df7dce"
server_key_version: "encryptionkey@0"
I20260810 01:44:22.909024 4442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/wal/instance:
uuid: "f3c4eecc390447c0ab41ca8cc0693c56"
format_stamp: "Formatted at 2026-08-10 01:44:22 on dist-test-slave-jlzn"
server_key: "ded4e52e77db25cb5b3f63f4aa5c3364"
server_key_iv: "04598b9af2ab2a1e3358e2b1e8df7dce"
server_key_version: "encryptionkey@0"
I20260810 01:44:22.912623 4442 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:44:22.914913 4462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:22.916082 4442 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260810 01:44:22.916195 4442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/wal
uuid: "f3c4eecc390447c0ab41ca8cc0693c56"
format_stamp: "Formatted at 2026-08-10 01:44:22 on dist-test-slave-jlzn"
server_key: "ded4e52e77db25cb5b3f63f4aa5c3364"
server_key_iv: "04598b9af2ab2a1e3358e2b1e8df7dce"
server_key_version: "encryptionkey@0"
I20260810 01:44:22.916289 4442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:22.941586 4442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:22.944242 4442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:22.944411 4442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:22.951243 4442 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.125:37755
I20260810 01:44:22.951267 4541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.125:37755 every 8 connection(s)
I20260810 01:44:22.952179 4442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
I20260810 01:44:22.954808 4542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:22.956852 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 4442
I20260810 01:44:22.956975 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-1/wal/instance
I20260810 01:44:22.957262 16617 external_mini_cluster.cc:1428] Setting key f4fecf045df10fe1711549de8076194e
I20260810 01:44:22.959054 4542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.58.124@KRBTEST.COM; defaulting to no policy
I20260810 01:44:22.968509 4430 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.124@KRBTEST.COM" created.
Aug 10 01:44:22 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
Aug 10 01:44:22 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
I20260810 01:44:22.976094 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.960917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39058 (local address 127.16.58.126:40561)
0810 01:44:22.961077 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:22.961082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:22.961883 (+ 801us) server_negotiation.cc:407] Connection header received
0810 01:44:22.963013 (+ 1130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:22.963015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:22.963061 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:22.963121 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:22.964613 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.965162 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.966790 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.967038 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.967113 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:22.971302 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:22.971305 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:22.971308 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:22.971330 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:22.972906 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:22.973479 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:22.973483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:22.973485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:22.973566 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:22.973947 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:22.973951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:22.973952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:22.974184 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:22.974286 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:22.975757 (+ 1471us) server_negotiation.cc:299] Negotiation successful
0810 01:44:22.975915 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:44:22.977598 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.961213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40561 (local address 127.0.0.1:39058)
0810 01:44:22.961691 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.961760 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:22.962799 (+ 1039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:22.963290 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:22.963298 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:22.963754 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:22.964473 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:22.964494 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.965296 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.965300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:22.966679 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:22.966692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.967178 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.967181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:22.967323 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:22.967873 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:22.967889 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:22.971137 (+ 3248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:22.973011 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:22.973017 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:22.973028 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:22.973372 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:22.973666 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:22.973669 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:22.973671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:22.973853 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:22.974301 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:22.974307 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:22.974639 (+ 332us) client_negotiation.cc:769] Sending connection context
0810 01:44:22.976259 (+ 1620us) client_negotiation.cc:240] Negotiation successful
0810 01:44:22.976594 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":106,"threads_started":1}
I20260810 01:44:22.977905 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.968889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:37755 (local address 127.0.0.1:51754)
0810 01:44:22.969013 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.969025 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:22.969096 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:22.969666 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:22.969668 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:22.969811 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:22.969912 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:22.969917 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.971238 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.971242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:22.972041 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:22.972052 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.972820 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.972823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:22.972932 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:22.973366 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:22.973377 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:22.974665 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:22.976457 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:22.976460 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:22.976462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:22.976682 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:22.976950 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:22.976953 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:22.976955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:22.977034 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:22.977446 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:22.977449 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:22.977542 (+ 93us) client_negotiation.cc:769] Sending connection context
0810 01:44:22.977626 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 01:44:22.977755 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 01:44:22.978003 4548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.968999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51754 (local address 127.16.58.125:37755)
0810 01:44:22.969285 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:22.969294 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:22.969313 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:44:22.969353 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:22.969357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:22.969511 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:22.969664 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:22.970002 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.971080 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.972155 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.972701 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.972816 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:22.974791 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:22.974802 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:22.974815 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:22.974843 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:22.976366 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:22.976783 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:22.976789 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:22.976790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:22.976869 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:22.977112 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:22.977115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:22.977117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:22.977349 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:22.977460 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:22.977727 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 01:44:22.977856 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":112,"threads_started":1}
I20260810 01:44:22.979871 4430 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:44:22.980180 4542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:44:22.980582 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.980309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53066)
0810 01:44:22.980445 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.980513 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 01:44:22.981205 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.980984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53070)
0810 01:44:22.981109 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.981153 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260810 01:44:22.981328 4430 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:46027: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Aug 10 01:44:22 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab.
Entry for principal kudu/127.16.58.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab.
I20260810 01:44:22.985901 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.124:46027
--webserver_interface=127.16.58.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab
--principal=kudu/127.16.58.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:45099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:40561,127.16.58.125:37755,127.16.58.124:46027
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:44:22.987665 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.980588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:37755 (local address 127.0.0.1:51768)
0810 01:44:22.981009 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.981020 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:22.981093 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:22.981293 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:22.981295 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:22.981450 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:22.981539 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:22.981545 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.982257 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.982260 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:22.982782 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:22.982789 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.983282 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.983285 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:22.983347 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:22.983719 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:22.983729 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:22.984876 (+ 1147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:22.986416 (+ 1540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:22.986420 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:22.986421 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:22.986593 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:22.986821 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:22.986824 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:22.986826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:22.986898 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:22.987204 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:22.987207 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:22.987286 (+ 79us) client_negotiation.cc:769] Sending connection context
0810 01:44:22.987367 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 01:44:22.987491 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363}
I20260810 01:44:22.987690 4548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.980669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51768 (local address 127.16.58.125:37755)
0810 01:44:22.980760 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:22.980764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:22.981077 (+ 313us) server_negotiation.cc:407] Connection header received
0810 01:44:22.981174 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:22.981177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:22.981212 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:22.981272 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:22.981640 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.982168 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.982879 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:22.983108 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:22.983191 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:22.984999 (+ 1808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:22.985001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:22.985003 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:22.985022 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:22.986327 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:22.986674 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:22.986677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:22.986679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:22.986749 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:22.986969 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:22.986972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:22.986974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:22.987124 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:22.987203 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:22.987434 (+ 231us) server_negotiation.cc:299] Negotiation successful
0810 01:44:22.987547 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":34}
I20260810 01:44:22.988324 4542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:44:22.988920 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.988709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53078)
0810 01:44:22.988806 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.988868 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 01:44:22.989464 4466 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
I20260810 01:44:22.990239 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:22.990052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53086)
0810 01:44:22.990147 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:22.990192 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 01:44:22.990353 4542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:46027: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
I20260810 01:44:23.012470 4430 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } attempt: 1
I20260810 01:44:23.013188 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.012893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53088)
0810 01:44:23.013039 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.013102 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 01:44:23.013849 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.013635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53100)
0810 01:44:23.013730 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.013782 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 01:44:23.013965 4430 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:46027: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
I20260810 01:44:23.039580 4542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } attempt: 1
I20260810 01:44:23.040364 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.040081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53106)
0810 01:44:23.040225 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.040285 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260810 01:44:23.041061 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.040880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53108)
0810 01:44:23.040963 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.041004 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 01:44:23.041190 4542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:46027: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
I20260810 01:44:23.089141 4430 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } attempt: 2
I20260810 01:44:23.090065 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.089680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53120)
0810 01:44:23.089867 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.089943 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260810 01:44:23.090773 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.090535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53126)
0810 01:44:23.090639 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.090697 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 01:44:23.090909 4430 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:46027: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
W20260810 01:44:23.099291 4550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:23.099534 4550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:23.099573 4550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:23.103739 4550 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:23.103796 4550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:23.103847 4550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:23.103874 4550 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:23.103895 4550 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:23.109274 4550 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:45099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:40561,127.16.58.125:37755,127.16.58.124:46027
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab
--principal=kudu/127.16.58.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.124:46027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.58.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:23.109334 4542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } attempt: 2
I20260810 01:44:23.110145 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.109856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53132)
0810 01:44:23.109994 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.110065 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 01:44:23.110466 4550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:23.110934 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.110715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53146)
0810 01:44:23.110823 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.110872 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 01:44:23.111045 4542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:46027: Network error: Client connection negotiation failed: client connection to 127.16.58.124:46027: connect: Connection refused (error 111)
I20260810 01:44:23.111553 4550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:23.119740 4563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:23.119757 4560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:23.119740 4565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:23.120046 4550 server_base.cc:1034] running on GCE node
I20260810 01:44:23.120693 4550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:23.121770 4550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:23.122931 4550 hybrid_clock.cc:648] HybridClock initialized: now 1786326263122906 us; error 33 us; skew 500 ppm
Aug 10 01:44:23 dist-test-slave-jlzn krb5kdc[4304](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326263, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:23.125592 4550 init.cc:377] Logged in from keytab as kudu/127.16.58.124@KRBTEST.COM (short username kudu)
I20260810 01:44:23.126398 4550 webserver.cc:460] Webserver started at http://127.16.58.124:46441/ using document root <none> and password file <none>
I20260810 01:44:23.126901 4550 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:23.126966 4550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:23.127189 4550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:23.129240 4550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/data/instance:
uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6"
format_stamp: "Formatted at 2026-08-10 01:44:23 on dist-test-slave-jlzn"
server_key: "f1700410039102caad2f40d5998f14af"
server_key_iv: "19243479870eccf8f396c2538de4aa3f"
server_key_version: "encryptionkey@0"
I20260810 01:44:23.129760 4550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/wal/instance:
uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6"
format_stamp: "Formatted at 2026-08-10 01:44:23 on dist-test-slave-jlzn"
server_key: "f1700410039102caad2f40d5998f14af"
server_key_iv: "19243479870eccf8f396c2538de4aa3f"
server_key_version: "encryptionkey@0"
I20260810 01:44:23.133459 4550 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:44:23.135697 4577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:23.136842 4550 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:23.136953 4550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/wal
uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6"
format_stamp: "Formatted at 2026-08-10 01:44:23 on dist-test-slave-jlzn"
server_key: "f1700410039102caad2f40d5998f14af"
server_key_iv: "19243479870eccf8f396c2538de4aa3f"
server_key_version: "encryptionkey@0"
I20260810 01:44:23.137039 4550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:23.165573 4550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:23.168919 4550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:23.169134 4550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:23.176277 4550 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.124:46027
I20260810 01:44:23.176290 4649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.124:46027 every 8 connection(s)
I20260810 01:44:23.177259 4550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
I20260810 01:44:23.180101 4650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:23.182349 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 4550
I20260810 01:44:23.182446 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786326110151381-16617-0/minicluster-data/master-2/wal/instance
I20260810 01:44:23.182727 16617 external_mini_cluster.cc:1428] Setting key db5a2e3a29bb28e087056affb3a53e85
I20260810 01:44:23.184377 4650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:44:23.190059 4430 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } attempt: 3
Aug 10 01:44:23 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326263, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
Aug 10 01:44:23 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
Aug 10 01:44:23 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
I20260810 01:44:23.197692 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.186450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39062 (local address 127.16.58.126:40561)
0810 01:44:23.186605 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.186610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.186983 (+ 373us) server_negotiation.cc:407] Connection header received
0810 01:44:23.187139 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.187142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.187197 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.187282 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.188013 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.188672 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.189959 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.190287 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.190384 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.193025 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.193029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.193031 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.193058 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.194898 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.195454 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.195458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.195460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.195554 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.196174 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.196177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.196179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.196416 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.196499 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.197374 (+ 875us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.197503 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:44:23.198747 4653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.184175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53160 (local address 127.16.58.124:46027)
0810 01:44:23.184612 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.184631 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.184678 (+ 47us) server_negotiation.cc:407] Connection header received
0810 01:44:23.185507 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.185532 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.185935 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.186281 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.187105 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.188401 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.189521 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.190068 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.190216 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.193508 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.193516 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.193530 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.193556 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.195327 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.195855 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.195862 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.195863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.196056 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.196375 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.196378 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.196380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.196886 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.197103 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.197909 (+ 806us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.198062 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":280,"spinlock_wait_cycles":4224,"thread_start_us":105,"threads_started":1}
I20260810 01:44:23.198747 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.186402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40561 (local address 127.0.0.1:39062)
0810 01:44:23.186831 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.186877 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:23.186999 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:23.187326 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:23.187330 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:23.187668 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:23.187881 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.187894 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.188783 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.188786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.189838 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.189848 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.190445 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.190449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.190552 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.191020 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:23.191041 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:23.192867 (+ 1826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:23.195009 (+ 2142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.195018 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.195030 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.195368 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.195840 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.195844 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.195846 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.196056 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.196583 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:23.196590 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:23.196884 (+ 294us) client_negotiation.cc:769] Sending connection context
0810 01:44:23.197060 (+ 176us) client_negotiation.cc:240] Negotiation successful
0810 01:44:23.197426 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"mutex_wait_us":63,"spinlock_wait_cycles":3328,"thread_start_us":153,"threads_started":1}
I20260810 01:44:23.199415 4436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.190499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53172)
0810 01:44:23.191047 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.191069 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:23.191156 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:23.191362 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:23.191365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:23.191550 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:23.191631 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.191636 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.192483 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.192487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.193014 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.193022 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.193587 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.193590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.193676 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.194152 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:23.194165 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:23.195632 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:23.198059 (+ 2427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.198062 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.198064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.198248 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.198498 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.198501 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.198503 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.198589 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.198964 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:23.198968 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:23.199070 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 01:44:23.199177 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 01:44:23.199303 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478}
I20260810 01:44:23.200405 4657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.190606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53172 (local address 127.16.58.124:46027)
0810 01:44:23.190889 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.190897 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.191130 (+ 233us) server_negotiation.cc:407] Connection header received
0810 01:44:23.191225 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.191228 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.191268 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.191336 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.191736 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.192395 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.193133 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.193454 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.193581 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.195782 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.195786 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.195789 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.195847 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.197967 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.198334 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.198337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.198339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.198418 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.198668 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.198671 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.198673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.198840 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.198959 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.199696 (+ 737us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.200256 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":95,"threads_started":1}
I20260810 01:44:23.200364 4650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:44:23.202199 4542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } attempt: 3
I20260810 01:44:23.203752 4430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49: Bootstrap starting.
Aug 10 01:44:23 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
Aug 10 01:44:23 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
I20260810 01:44:23.207372 4430 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:23.208287 4430 log.cc:824] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:23.209702 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.201543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39074 (local address 127.16.58.126:40561)
0810 01:44:23.201641 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.201644 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.201712 (+ 68us) server_negotiation.cc:407] Connection header received
0810 01:44:23.201836 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.201839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.201878 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.201939 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.202534 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.203159 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.204141 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.204357 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.204441 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.206515 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.206519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.206521 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.206547 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.208066 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.208460 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.208463 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.208465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.208566 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.208870 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.208874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.208875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.209094 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.209261 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.209442 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.209549 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:44:23.211949 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.202556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53180)
0810 01:44:23.202667 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.202681 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:23.202759 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:23.203230 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:23.203233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:23.203420 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:23.203538 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.203546 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.204521 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.204525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.205280 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.205295 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.205880 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.205884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.205963 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.206371 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:23.206385 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:23.207763 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:23.210379 (+ 2616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.210382 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.210385 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.210576 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.210895 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.210899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.210901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.210995 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.211445 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:23.211449 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:23.211562 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 01:44:23.211645 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 01:44:23.211770 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 01:44:23.212450 4657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.202886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53180 (local address 127.16.58.124:46027)
0810 01:44:23.203003 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.203007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.203019 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:44:23.203050 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.203053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.203100 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.203177 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.203661 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.204391 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.205436 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.205752 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.206183 (+ 431us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.207920 (+ 1737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.207923 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.207926 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.207950 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.210266 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.210700 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.210703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.210704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.210788 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.211128 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.211131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.211132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.211332 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.212131 (+ 799us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.212211 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.212318 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 01:44:23 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326263, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
I20260810 01:44:23.212989 4430 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49: No bootstrap required, opened a new log
I20260810 01:44:23.215482 4542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56: Bootstrap starting.
I20260810 01:44:23.215935 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.201044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:37755 (local address 127.0.0.1:51784)
0810 01:44:23.208348 (+ 7304us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.208361 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:23.208571 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:23.208901 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:23.208903 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:23.209057 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:23.209163 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.209170 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.210020 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.210023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.210627 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.210637 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.211268 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.211271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.211349 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.211730 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:23.211743 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:23.213045 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:23.214553 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.214556 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.214558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.214741 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.214987 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.214990 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.214992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.215070 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.215443 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:23.215446 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:23.215542 (+ 96us) client_negotiation.cc:769] Sending connection context
0810 01:44:23.215627 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 01:44:23.215747 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7229}
I20260810 01:44:23.215950 4548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.201156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51784 (local address 127.16.58.125:37755)
0810 01:44:23.201277 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.201280 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.208413 (+ 7133us) server_negotiation.cc:407] Connection header received
0810 01:44:23.208667 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.208670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.208715 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.208786 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.209297 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.209886 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.210739 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.211052 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.211155 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.213170 (+ 2015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.213173 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.213176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.213200 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.214445 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.214829 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.214832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.214833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.214904 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.215151 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.215154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.215155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.215347 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.215434 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.215695 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.215796 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:44:23.216560 4650 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:44:23.216988 4430 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } }
I20260810 01:44:23.217211 4430 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:23.217269 4430 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd76d563a23d45a4a24c528b274c6b49, State: Initialized, Role: FOLLOWER
I20260810 01:44:23.217741 4430 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } }
I20260810 01:44:23.218250 4542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:23.218254 4660 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.218405 4660 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:44:23.219136 4430 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:23.219116 4542 log.cc:824] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:44:23 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326263, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
I20260810 01:44:23.221653 4542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56: No bootstrap required, opened a new log
W20260810 01:44:23.222777 4361 tablet.cc:2369] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:44:23.225050 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.216980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:46027 (local address 127.0.0.1:53192)
0810 01:44:23.217132 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:23.217145 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:23.217218 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:23.217393 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:23.217395 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:23.217566 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:23.217636 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.217641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.218385 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.218388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.218978 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:23.218997 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.219357 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.219361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:23.219433 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.219954 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:23.219967 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:23.221461 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:23.223274 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.223276 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.223278 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.223503 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.223761 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:23.223763 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:23.223765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:23.223869 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:23.224560 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:23.224562 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:23.224652 (+ 90us) client_negotiation.cc:769] Sending connection context
0810 01:44:23.224749 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 01:44:23.224882 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104}
I20260810 01:44:23.225610 4657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.217024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53192 (local address 127.16.58.124:46027)
0810 01:44:23.217111 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.217114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.217185 (+ 71us) server_negotiation.cc:407] Connection header received
0810 01:44:23.217280 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.217283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.217316 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.217371 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.217734 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.218273 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.219087 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.219268 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.219340 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.221599 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.221602 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.221605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.221626 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.223186 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.223592 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.223596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.223597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.223678 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.224195 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.224198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.224199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.224411 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.224523 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.225349 (+ 826us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.225457 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260810 01:44:23.225642 4677 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:44:23.225709 4677 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 10 01:44:23 dist-test-slave-jlzn krb5kdc[4304](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
I20260810 01:44:23.228638 4650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6: Bootstrap starting.
I20260810 01:44:23.224604 4322 master_runner.cc:186] Error getting master registration for 127.16.58.125:37755: OK, instance_id { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" instance_seqno: 1786326262949376 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:44:23.229179 4322 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 01:44:23.230381 4548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.211002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51788 (local address 127.16.58.125:37755)
0810 01:44:23.216090 (+ 5088us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.216094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.220008 (+ 3914us) server_negotiation.cc:407] Connection header received
0810 01:44:23.220199 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.220202 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.220249 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.220323 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.221302 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.221986 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.223124 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.223427 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.223504 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.226272 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.226276 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.226278 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.226304 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.227920 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.228403 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.228406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.228408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.228511 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.228822 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.228825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.228827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.229043 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.230009 (+ 966us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.230092 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.230218 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5032,"thread_start_us":121,"threads_started":1}
I20260810 01:44:23.231448 4650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:23.232380 4650 log.cc:824] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:23.233671 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:44:23.233790 4542 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } }
I20260810 01:44:23.233992 4542 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:23.234045 4542 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c4eecc390447c0ab41ca8cc0693c56, State: Initialized, Role: FOLLOWER
I20260810 01:44:23.234472 4542 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } }
I20260810 01:44:23.234900 4680 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.235095 4680 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:44:23.235677 4542 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:23.237754 4650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6: No bootstrap required, opened a new log
W20260810 01:44:23.241472 4706 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:44:23.241550 4706 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:44:23.241906 4650 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } }
I20260810 01:44:23.242166 4650 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:23.242233 4650 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c6ae6ec70114d9b8d8be103edb7e9b6, State: Initialized, Role: FOLLOWER
I20260810 01:44:23.242722 4650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } }
I20260810 01:44:23.244030 4650 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:23.243068 4442 master_runner.cc:186] Error getting master registration for 127.16.58.124:46027: OK, instance_id { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" instance_seqno: 1786326263174336 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:44:23.246289 4442 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 01:44:23.252117 4710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.252276 4710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:44:23.252801 4550 master_runner.cc:263] No leader master found from master 7c6ae6ec70114d9b8d8be103edb7e9b6
I20260810 01:44:23.252858 4550 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 01:44:23.252942 4725 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:44:23.253010 4725 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:44:23.255653 4548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.236678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51796 (local address 127.16.58.125:37755)
0810 01:44:23.236797 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.236801 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.241461 (+ 4660us) server_negotiation.cc:407] Connection header received
0810 01:44:23.241775 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.241778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.241827 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.241898 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.242863 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.243614 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.245890 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.246210 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.246286 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.251020 (+ 4734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.251025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.251028 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.251056 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.253205 (+ 2149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.254260 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.254264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.254266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.254365 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.254670 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.254674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.254676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.254892 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.255020 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.255357 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.255481 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:44:23.260102 4438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.237120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39078 (local address 127.16.58.126:40561)
0810 01:44:23.237228 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.237232 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.244642 (+ 7410us) server_negotiation.cc:407] Connection header received
0810 01:44:23.245880 (+ 1238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.245883 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.245934 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.245981 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.247076 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.247847 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.252402 (+ 4555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.252762 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.252839 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.255545 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.255549 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.255552 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.255579 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.257536 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.258733 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.258737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.258739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.258832 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.259138 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.259142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.259143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.259351 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.259446 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.259830 (+ 384us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.259954 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:44:23.260471 4657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:23.237763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53208 (local address 127.16.58.124:46027)
0810 01:44:23.237874 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:23.237878 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:23.244348 (+ 6470us) server_negotiation.cc:407] Connection header received
0810 01:44:23.244454 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:23.244457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:23.244502 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:23.244569 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:23.246983 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.247759 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.251411 (+ 3652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:23.251782 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:23.251882 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:23.255955 (+ 4073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:23.255959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:23.255962 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:23.255988 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:23.258281 (+ 2293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.259091 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.259095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.259097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.259184 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:23.259488 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:23.259491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:23.259493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:23.259704 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:23.259860 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:23.260228 (+ 368us) server_negotiation.cc:299] Negotiation successful
0810 01:44:23.260334 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:44:23.346457 4680 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:44:23.346653 4680 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } }
I20260810 01:44:23.347548 4680 leader_election.cc:288] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd76d563a23d45a4a24c528b274c6b49 (127.16.58.126:40561), 7c6ae6ec70114d9b8d8be103edb7e9b6 (127.16.58.124:46027)
I20260810 01:44:23.348182 4389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd76d563a23d45a4a24c528b274c6b49" is_pre_election: true
I20260810 01:44:23.348182 4615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" is_pre_election: true
I20260810 01:44:23.348526 4615 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3c4eecc390447c0ab41ca8cc0693c56 in term 0.
I20260810 01:44:23.348532 4389 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3c4eecc390447c0ab41ca8cc0693c56 in term 0.
I20260810 01:44:23.348968 4466 leader_election.cc:302] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c6ae6ec70114d9b8d8be103edb7e9b6, f3c4eecc390447c0ab41ca8cc0693c56; no voters:
I20260810 01:44:23.349411 4680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:44:23.349483 4680 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:44:23.349526 4680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:23.350591 4680 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } }
I20260810 01:44:23.350942 4680 leader_election.cc:288] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [CANDIDATE]: Term 1 election: Requested vote from peers dd76d563a23d45a4a24c528b274c6b49 (127.16.58.126:40561), 7c6ae6ec70114d9b8d8be103edb7e9b6 (127.16.58.124:46027)
I20260810 01:44:23.351349 4615 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6"
I20260810 01:44:23.351349 4389 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd76d563a23d45a4a24c528b274c6b49"
I20260810 01:44:23.351480 4615 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:23.351480 4389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:23.352860 4389 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c4eecc390447c0ab41ca8cc0693c56 in term 1.
I20260810 01:44:23.352860 4615 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3c4eecc390447c0ab41ca8cc0693c56 in term 1.
I20260810 01:44:23.353211 4466 leader_election.cc:302] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7c6ae6ec70114d9b8d8be103edb7e9b6, dd76d563a23d45a4a24c528b274c6b49, f3c4eecc390447c0ab41ca8cc0693c56; no voters:
I20260810 01:44:23.353436 4680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:44:23.353681 4680 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [term 1 LEADER]: Becoming Leader. State: Replica: f3c4eecc390447c0ab41ca8cc0693c56, State: Running, Role: LEADER
I20260810 01:44:23.354071 4680 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } }
I20260810 01:44:23.355934 4728 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3c4eecc390447c0ab41ca8cc0693c56. Latest consensus state: current_term: 1 leader_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.356108 4728 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:23.357985 4731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:44:23.359381 4731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:44:23.365168 4615 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [term 1 FOLLOWER]: Refusing update from remote peer f3c4eecc390447c0ab41ca8cc0693c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:23.365934 4680 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:23.370395 4710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3c4eecc390447c0ab41ca8cc0693c56. Latest consensus state: current_term: 1 leader_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.370533 4710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:44:23.371630 4389 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [term 1 FOLLOWER]: Refusing update from remote peer f3c4eecc390447c0ab41ca8cc0693c56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:23.372321 4680 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:23.376559 4660 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3c4eecc390447c0ab41ca8cc0693c56. Latest consensus state: current_term: 1 leader_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.376703 4660 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:44:23.379745 4680 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.379891 4680 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:23.381043 4660 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.381160 4660 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:44:23.381618 4733 mvcc.cc:205] Tried to move back new op lower bound from 7316792374735396864 to 7316792374701215744. Current Snapshot: MvccSnapshot[applied={T|T < 7316792374735396864}]
I20260810 01:44:23.383684 4728 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.385079 4710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd76d563a23d45a4a24c528b274c6b49" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40561 } } peers { permanent_uuid: "f3c4eecc390447c0ab41ca8cc0693c56" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 37755 } } peers { permanent_uuid: "7c6ae6ec70114d9b8d8be103edb7e9b6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 46027 } } }
I20260810 01:44:23.385203 4710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:44:23.385572 4739 mvcc.cc:205] Tried to move back new op lower bound from 7316792374735396864 to 7316792374701215744. Current Snapshot: MvccSnapshot[applied={T|T < 7316792374735396864}]
I20260810 01:44:23.386269 4728 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:23.386853 4731 catalog_manager.cc:1347] Generated new cluster ID: 325bc3cc554e45f69c0b9fc513baabd7
I20260810 01:44:23.386909 4731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:44:23.387315 4734 mvcc.cc:205] Tried to move back new op lower bound from 7316792374735396864 to 7316792374701215744. Current Snapshot: MvccSnapshot[applied={T|T < 7316792374735396864}]
I20260810 01:44:23.403357 4731 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:44:23.404685 4731 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:44:23.416893 4731 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3c4eecc390447c0ab41ca8cc0693c56: Generated new TSK 0
I20260810 01:44:23.417682 4731 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:44:24.226895 4677 catalog_manager.cc:1259] Loaded cluster ID: 325bc3cc554e45f69c0b9fc513baabd7
I20260810 01:44:24.226975 4677 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49: loading cluster ID for follower catalog manager: success
I20260810 01:44:24.228677 4677 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49: acquiring CA information for follower catalog manager: success
I20260810 01:44:24.229805 4677 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dd76d563a23d45a4a24c528b274c6b49: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:44:24.254074 4725 catalog_manager.cc:1259] Loaded cluster ID: 325bc3cc554e45f69c0b9fc513baabd7
I20260810 01:44:24.254139 4725 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6: loading cluster ID for follower catalog manager: success
I20260810 01:44:24.255659 4725 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6: acquiring CA information for follower catalog manager: success
I20260810 01:44:24.256752 4725 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7c6ae6ec70114d9b8d8be103edb7e9b6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:44:24.478794 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 4322
I20260810 01:44:24.493291 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 4442
I20260810 01:44:24.503147 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 4550
2026-08-10T01:44:24Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3182 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:44:24 dist-test-slave-jlzn krb5kdc[4756](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:44:24 dist-test-slave-jlzn krb5kdc[4756](info): set up 2 sockets
Aug 10 01:44:24 dist-test-slave-jlzn krb5kdc[4756](info): commencing operation
krb5kdc: starting...
W20260810 01:44:25.637435 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:44:25 dist-test-slave-jlzn krb5kdc[4756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:44:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:44:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:44:25.748183 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:37961
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:37961
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:25.854056 4778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:25.854277 4778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:25.854331 4778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:25.858162 4778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:25.858213 4778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:25.858239 4778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:25.858258 4778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:25.858279 4778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:25.863202 4778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:37961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:37961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:25.864145 4778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:25.865072 4778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:25.872963 4785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:25.873008 4792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:25.872983 4783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:25.873250 4778 server_base.cc:1034] running on GCE node
I20260810 01:44:25.873765 4778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:25.874737 4778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:25.875860 4778 hybrid_clock.cc:648] HybridClock initialized: now 1786326265875847 us; error 27 us; skew 500 ppm
Aug 10 01:44:25 dist-test-slave-jlzn krb5kdc[4756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326265, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:25.878401 4778 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:44:25.879190 4778 webserver.cc:460] Webserver started at http://127.16.58.126:34003/ using document root <none> and password file <none>
I20260810 01:44:25.879685 4778 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:25.879750 4778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:25.879963 4778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:25.881856 4778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "a07de02de21a41c89cf0281e886fdcba"
format_stamp: "Formatted at 2026-08-10 01:44:25 on dist-test-slave-jlzn"
server_key: "4985b29c60043a3836b79bc620a7e7fb"
server_key_iv: "c5cbdf08cebd5a5144ecf9beeddcf439"
server_key_version: "encryptionkey@0"
I20260810 01:44:25.882372 4778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "a07de02de21a41c89cf0281e886fdcba"
format_stamp: "Formatted at 2026-08-10 01:44:25 on dist-test-slave-jlzn"
server_key: "4985b29c60043a3836b79bc620a7e7fb"
server_key_iv: "c5cbdf08cebd5a5144ecf9beeddcf439"
server_key_version: "encryptionkey@0"
I20260810 01:44:25.885772 4778 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:44:25.887941 4802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:25.889014 4778 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:25.889135 4778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "a07de02de21a41c89cf0281e886fdcba"
format_stamp: "Formatted at 2026-08-10 01:44:25 on dist-test-slave-jlzn"
server_key: "4985b29c60043a3836b79bc620a7e7fb"
server_key_iv: "c5cbdf08cebd5a5144ecf9beeddcf439"
server_key_version: "encryptionkey@0"
I20260810 01:44:25.889226 4778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:25.910728 4778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:25.913750 4778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:25.913918 4778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:25.920387 4778 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:37961
I20260810 01:44:25.920401 4877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:37961 every 8 connection(s)
I20260810 01:44:25.921257 4778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:44:25.923174 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 4778
I20260810 01:44:25.923295 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:44:25.923581 16617 external_mini_cluster.cc:1428] Setting key 63af98b64a2e10121c9db1ec0a8dcdd1
I20260810 01:44:25.924182 4878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:25.929576 4878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba: Bootstrap starting.
I20260810 01:44:25.931849 4878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba: Neither blocks nor log segments found. Creating new log.
Aug 10 01:44:25 dist-test-slave-jlzn krb5kdc[4756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:25.932556 4878 log.cc:824] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:25.934625 4878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba: No bootstrap required, opened a new log
I20260810 01:44:25.937078 4882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:25.924810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53808 (local address 127.16.58.126:37961)
0810 01:44:25.925236 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:25.925252 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:25.925284 (+ 32us) server_negotiation.cc:407] Connection header received
0810 01:44:25.925905 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:25.925921 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:25.926212 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:25.926493 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:25.927269 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:25.928300 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:25.929203 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:25.929814 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:25.929978 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:25.932447 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:25.932452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:25.932464 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:25.932491 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:25.934234 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:25.934638 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:25.934644 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:25.934650 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:25.934788 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:25.935041 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:25.935044 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:25.935046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:25.935525 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:25.935727 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:25.935910 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 01:44:25.936183 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":146,"threads_started":1}
I20260810 01:44:25.938829 4878 raft_consensus.cc:348] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07de02de21a41c89cf0281e886fdcba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37961 } }
I20260810 01:44:25.939059 4878 raft_consensus.cc:374] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:25.939114 4878 raft_consensus.cc:729] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07de02de21a41c89cf0281e886fdcba, State: Initialized, Role: FOLLOWER
I20260810 01:44:25.939512 4878 consensus_queue.cc:260] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07de02de21a41c89cf0281e886fdcba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37961 } }
I20260810 01:44:25.939640 4878 raft_consensus.cc:388] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:44:25.939668 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:44:25.939707 4878 raft_consensus.cc:482] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:44:25.939797 4878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:25.940764 4878 raft_consensus.cc:504] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07de02de21a41c89cf0281e886fdcba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37961 } }
I20260810 01:44:25.941064 4878 leader_election.cc:302] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a07de02de21a41c89cf0281e886fdcba; no voters:
I20260810 01:44:25.941356 4878 leader_election.cc:288] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:44:25.941468 4884 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:44:25.941699 4884 raft_consensus.cc:686] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [term 1 LEADER]: Becoming Leader. State: Replica: a07de02de21a41c89cf0281e886fdcba, State: Running, Role: LEADER
I20260810 01:44:25.941990 4884 consensus_queue.cc:237] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07de02de21a41c89cf0281e886fdcba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37961 } }
I20260810 01:44:25.942412 4878 sys_catalog.cc:564] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:25.943404 4885 sys_catalog.cc:455] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a07de02de21a41c89cf0281e886fdcba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07de02de21a41c89cf0281e886fdcba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37961 } } }
I20260810 01:44:25.943535 4885 sys_catalog.cc:458] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:25.943933 4886 sys_catalog.cc:455] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [sys.catalog]: SysCatalogTable state changed. Reason: New leader a07de02de21a41c89cf0281e886fdcba. Latest consensus state: current_term: 1 leader_uuid: "a07de02de21a41c89cf0281e886fdcba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07de02de21a41c89cf0281e886fdcba" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37961 } } }
I20260810 01:44:25.944063 4886 sys_catalog.cc:458] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:25.943992 4897 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:44:25.946599 4897 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:44:25.952287 4897 catalog_manager.cc:1347] Generated new cluster ID: 07a7e534350f49bb84b42d2376013c0b
I20260810 01:44:25.952339 4897 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:44:25.970679 4897 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:44:25.971480 4897 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:44:25.977887 4897 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a07de02de21a41c89cf0281e886fdcba: Generated new TSK 0
I20260810 01:44:25.978417 4897 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:44:25.995606 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 4778
2026-08-10T01:44:26Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1494 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:44:26 dist-test-slave-jlzn krb5kdc[4914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:44:26 dist-test-slave-jlzn krb5kdc[4914](info): set up 2 sockets
Aug 10 01:44:26 dist-test-slave-jlzn krb5kdc[4914](info): commencing operation
krb5kdc: starting...
W20260810 01:44:27.123831 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:44:27 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:44:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:44:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:44:27.234056 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38409
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:38409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:27.339129 4929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:27.339378 4929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:27.339430 4929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:27.343304 4929 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:27.343357 4929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:27.343384 4929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:27.343403 4929 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:27.343430 4929 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:27.348491 4929 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:38409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:27.349390 4929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:27.350293 4929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:27.358106 4948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:27.358259 4929 server_base.cc:1034] running on GCE node
W20260810 01:44:27.358139 4942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:27.358099 4943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:27.358896 4929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:27.359866 4929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:27.361028 4929 hybrid_clock.cc:648] HybridClock initialized: now 1786326267361005 us; error 35 us; skew 500 ppm
Aug 10 01:44:27 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326267, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:27.366137 4929 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:44:27.366916 4929 webserver.cc:460] Webserver started at http://127.16.58.126:35105/ using document root <none> and password file <none>
I20260810 01:44:27.367385 4929 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:27.367440 4929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:27.367594 4929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:27.369478 4929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "05beece933c14328a2f61dadcc270d87"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "bc5c2f360f3c70159d3dd2a36f1a8eb7"
server_key_iv: "eb635fb300622ec248f7e933e74b626e"
server_key_version: "encryptionkey@0"
I20260810 01:44:27.369966 4929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "05beece933c14328a2f61dadcc270d87"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "bc5c2f360f3c70159d3dd2a36f1a8eb7"
server_key_iv: "eb635fb300622ec248f7e933e74b626e"
server_key_version: "encryptionkey@0"
I20260810 01:44:27.373304 4929 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:44:27.375406 4960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:27.376492 4929 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:27.376590 4929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "05beece933c14328a2f61dadcc270d87"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "bc5c2f360f3c70159d3dd2a36f1a8eb7"
server_key_iv: "eb635fb300622ec248f7e933e74b626e"
server_key_version: "encryptionkey@0"
I20260810 01:44:27.376673 4929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:27.388392 4929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:27.391065 4929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:27.391199 4929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:27.397536 4929 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:38409
I20260810 01:44:27.397775 5035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:38409 every 8 connection(s)
I20260810 01:44:27.398380 4929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:44:27.398679 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 4929
I20260810 01:44:27.398784 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:44:27.399070 16617 external_mini_cluster.cc:1428] Setting key 9676051c25165a3fb717f8894530a49d
I20260810 01:44:27.401257 5037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 01:44:27 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:27.407300 5037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Bootstrap starting.
I20260810 01:44:27.409418 5037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:27.410261 5037 log.cc:824] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:27.412078 5037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: No bootstrap required, opened a new log
I20260810 01:44:27.412180 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:27.400289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58146 (local address 127.16.58.126:38409)
0810 01:44:27.400657 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:27.400674 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:27.400710 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:44:27.401310 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:27.401330 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:27.401643 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:27.401889 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:27.402711 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.403664 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.404809 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.405249 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.405357 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:27.407966 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:27.407971 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:27.407982 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:27.408008 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:27.409454 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:27.409923 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:27.409928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:27.409932 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:27.410039 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:27.410303 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:27.410305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:27.410306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:27.410751 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:27.410937 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:27.411215 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 01:44:27.411469 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":115,"threads_started":1}
I20260810 01:44:27.415617 5037 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:27.415841 5037 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:27.415902 5037 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05beece933c14328a2f61dadcc270d87, State: Initialized, Role: FOLLOWER
I20260810 01:44:27.416282 5037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:27.416407 5037 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:44:27.416472 5037 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:44:27.416569 5037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:27.417353 5037 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:27.417658 5037 leader_election.cc:302] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05beece933c14328a2f61dadcc270d87; no voters:
I20260810 01:44:27.417940 5037 leader_election.cc:288] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:44:27.418006 5043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:44:27.418273 5043 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 1 LEADER]: Becoming Leader. State: Replica: 05beece933c14328a2f61dadcc270d87, State: Running, Role: LEADER
I20260810 01:44:27.418587 5043 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:27.419099 5037 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:27.420055 5046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05beece933c14328a2f61dadcc270d87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } } }
I20260810 01:44:27.420176 5046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:27.420454 5045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05beece933c14328a2f61dadcc270d87. Latest consensus state: current_term: 1 leader_uuid: "05beece933c14328a2f61dadcc270d87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } } }
I20260810 01:44:27.420531 5056 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:44:27.420578 5045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:27.423233 5056 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:44:27.428076 5056 catalog_manager.cc:1347] Generated new cluster ID: ea33e1eca17746b6bbd8f0dcccd335c5
I20260810 01:44:27.428126 5056 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:44:27.451197 5056 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:44:27.452432 5056 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:44:27.459733 5056 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Generated new TSK 0
I20260810 01:44:27.460343 5056 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:44:27.490576 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38409
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:27.614406 5073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:27.614642 5073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:27.614703 5073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:27.618521 5073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:27.618572 5073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:27.618651 5073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:44:27.623723 5073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:27.624599 5073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:27.625485 5073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:27.634032 5088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:27.634035 5092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:27.634047 5085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:27.634361 5073 server_base.cc:1034] running on GCE node
I20260810 01:44:27.634713 5073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:27.635236 5073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:27.636386 5073 hybrid_clock.cc:648] HybridClock initialized: now 1786326267636371 us; error 25 us; skew 500 ppm
Aug 10 01:44:27 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326267, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:27.638922 5073 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:44:27.639681 5073 webserver.cc:460] Webserver started at http://127.16.58.65:45775/ using document root <none> and password file <none>
I20260810 01:44:27.640187 5073 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:27.640246 5073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:27.640400 5073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:27.642136 5073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "90a80720f88ece3f0dc109e6c64d817c"
server_key_iv: "c8b3209419dce6bdb220a536429c3af2"
server_key_version: "encryptionkey@0"
I20260810 01:44:27.642650 5073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "90a80720f88ece3f0dc109e6c64d817c"
server_key_iv: "c8b3209419dce6bdb220a536429c3af2"
server_key_version: "encryptionkey@0"
I20260810 01:44:27.645925 5073 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:44:27.648051 5104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:27.649103 5073 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:44:27.649209 5073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "90a80720f88ece3f0dc109e6c64d817c"
server_key_iv: "c8b3209419dce6bdb220a536429c3af2"
server_key_version: "encryptionkey@0"
I20260810 01:44:27.649294 5073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:27.666363 5073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:27.669149 5073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:27.669308 5073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:27.669821 5073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:27.670552 5073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:27.670598 5073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:27.670657 5073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:27.670684 5073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:27.678891 5073 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:42003
I20260810 01:44:27.678917 5276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:42003 every 8 connection(s)
I20260810 01:44:27.679689 5073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:44:27.686579 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 5073
I20260810 01:44:27.686719 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:44:27.687026 16617 external_mini_cluster.cc:1428] Setting key ba822d0ad2a4e41527eb23ccec67ab56
Aug 10 01:44:27 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326267, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:27.692281 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:27.681354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:59401 (local address 127.16.58.126:38409)
0810 01:44:27.681501 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:27.681506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:27.682239 (+ 733us) server_negotiation.cc:407] Connection header received
0810 01:44:27.683489 (+ 1250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:27.683492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:27.683539 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:27.683609 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:27.684644 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.685167 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.686185 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.686397 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.686459 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:27.689074 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:27.689077 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:27.689079 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:27.689102 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:27.690411 (+ 1309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:27.690880 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:27.690883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:27.690885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:27.690975 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:27.691251 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:27.691254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:27.691255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:27.691465 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:27.691579 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:27.692022 (+ 443us) server_negotiation.cc:299] Negotiation successful
0810 01:44:27.692138 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:44:27.692945 5281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:27.681693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:59401)
0810 01:44:27.682098 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:27.682146 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:27.683318 (+ 1172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:27.683748 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:27.683754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:27.684096 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:27.684528 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:27.684540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.685254 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.685256 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:27.686089 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:27.686097 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.686521 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.686525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:27.686732 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:27.687259 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:27.687275 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:27.688923 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:27.690534 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:27.690539 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:27.690549 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:27.690797 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:27.691053 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:27.691055 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:27.691056 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:27.691177 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:27.691564 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:27.691568 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:27.691775 (+ 207us) client_negotiation.cc:769] Sending connection context
0810 01:44:27.691952 (+ 177us) client_negotiation.cc:240] Negotiation successful
0810 01:44:27.692182 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":106,"threads_started":1}
I20260810 01:44:27.694119 5277 heartbeater.cc:347] Connected to a master server at 127.16.58.126:38409
I20260810 01:44:27.694322 5277 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:27.694734 5277 heartbeater.cc:511] Master 127.16.58.126:38409 requested a full tablet report, sending...
I20260810 01:44:27.696302 4987 ts_manager.cc:194] Registered new tserver with Master: d2f3b6a47b4f4cc081351e4bfc6066a2 (127.16.58.65:42003)
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:44:27.697817 4987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:59401
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:44:27.712709 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38409
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:27.818805 5284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:27.819062 5284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:27.819104 5284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:27.823105 5284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:27.823158 5284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:27.823210 5284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:44:27.828156 5284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:27.829038 5284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:27.829970 5284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:27.838963 5295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:27.838958 5293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:27.838933 5292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:27.838950 5284 server_base.cc:1034] running on GCE node
I20260810 01:44:27.839566 5284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:27.840171 5284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:27.841344 5284 hybrid_clock.cc:648] HybridClock initialized: now 1786326267841328 us; error 26 us; skew 500 ppm
Aug 10 01:44:27 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326267, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:27.843940 5284 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:44:27.844758 5284 webserver.cc:460] Webserver started at http://127.16.58.66:42959/ using document root <none> and password file <none>
I20260810 01:44:27.845256 5284 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:27.845316 5284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:27.845525 5284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:27.847441 5284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "0c2cbdae9eed48f6bdf6e3e76967e425"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "46120f27782a0c43655ff25573bf525b"
server_key_iv: "ec11ec70d5979c2f8a7a47a706a46d91"
server_key_version: "encryptionkey@0"
I20260810 01:44:27.848004 5284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "0c2cbdae9eed48f6bdf6e3e76967e425"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "46120f27782a0c43655ff25573bf525b"
server_key_iv: "ec11ec70d5979c2f8a7a47a706a46d91"
server_key_version: "encryptionkey@0"
I20260810 01:44:27.851332 5284 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:44:27.853641 5308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:27.854728 5284 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 01:44:27.854825 5284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "0c2cbdae9eed48f6bdf6e3e76967e425"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "46120f27782a0c43655ff25573bf525b"
server_key_iv: "ec11ec70d5979c2f8a7a47a706a46d91"
server_key_version: "encryptionkey@0"
I20260810 01:44:27.854918 5284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:27.870261 5284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:27.873092 5284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:27.873251 5284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:27.873783 5284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:27.874536 5284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:27.874583 5284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:27.874624 5284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:27.874660 5284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:27.882899 5284 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:34837
I20260810 01:44:27.882926 5486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:34837 every 8 connection(s)
I20260810 01:44:27.883713 5284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:44:27.887830 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 5284
I20260810 01:44:27.887954 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:44:27.888229 16617 external_mini_cluster.cc:1428] Setting key 6c38250d520026694f75d87f59957871
Aug 10 01:44:27 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326267, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:27.897367 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:27.885466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:48685 (local address 127.16.58.126:38409)
0810 01:44:27.885581 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:27.885584 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:27.886349 (+ 765us) server_negotiation.cc:407] Connection header received
0810 01:44:27.887709 (+ 1360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:27.887712 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:27.887772 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:27.887868 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:27.889108 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.889736 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.891220 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.891423 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.891485 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:27.894000 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:27.894004 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:27.894006 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:27.894030 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:27.895411 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:27.895882 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:27.895886 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:27.895888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:27.895989 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:27.896301 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:27.896304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:27.896306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:27.896538 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:27.896654 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:27.897071 (+ 417us) server_negotiation.cc:299] Negotiation successful
0810 01:44:27.897197 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":39}
I20260810 01:44:27.898048 5491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:27.885778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:48685)
0810 01:44:27.886214 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:27.886254 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:27.887493 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:27.888046 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:27.888055 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:27.888438 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:27.888981 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:27.889000 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.889857 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.889861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:27.891109 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:27.891131 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:27.891555 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:27.891559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:27.891770 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:27.892342 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:27.892357 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:27.893843 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:27.895520 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:27.895525 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:27.895535 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:27.895780 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:27.896072 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:27.896073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:27.896075 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:27.896216 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:27.896635 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:27.896641 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:27.896851 (+ 210us) client_negotiation.cc:769] Sending connection context
0810 01:44:27.896997 (+ 146us) client_negotiation.cc:240] Negotiation successful
0810 01:44:27.897238 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":118,"threads_started":1}
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:44:27.899117 5487 heartbeater.cc:347] Connected to a master server at 127.16.58.126:38409
I20260810 01:44:27.899341 5487 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:27.899845 5487 heartbeater.cc:511] Master 127.16.58.126:38409 requested a full tablet report, sending...
I20260810 01:44:27.900830 4987 ts_manager.cc:194] Registered new tserver with Master: 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
I20260810 01:44:27.901526 4987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:48685
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:44:27.914932 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38409
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:28.021080 5498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:28.021330 5498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:28.021392 5498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:28.025274 5498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:28.025326 5498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:28.025400 5498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:44:28.030273 5498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:28.031164 5498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:28.032090 5498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:28.040899 5506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:28.041018 5498 server_base.cc:1034] running on GCE node
W20260810 01:44:28.040913 5508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:28.040905 5505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:28.041487 5498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:28.042027 5498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:28.043177 5498 hybrid_clock.cc:648] HybridClock initialized: now 1786326268043165 us; error 23 us; skew 500 ppm
Aug 10 01:44:28 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326268, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:28.045682 5498 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:44:28.046424 5498 webserver.cc:460] Webserver started at http://127.16.58.67:37941/ using document root <none> and password file <none>
I20260810 01:44:28.046895 5498 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:28.046949 5498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:28.047102 5498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:28.048992 5498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "1330bf3868bc421f862b7c34a1eb97dc"
format_stamp: "Formatted at 2026-08-10 01:44:28 on dist-test-slave-jlzn"
server_key: "34293bc3e7e86ca20fd2ac1b95c92b63"
server_key_iv: "4b5827ffa5cf5e444154525963e028e4"
server_key_version: "encryptionkey@0"
I20260810 01:44:28.049484 5498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "1330bf3868bc421f862b7c34a1eb97dc"
format_stamp: "Formatted at 2026-08-10 01:44:28 on dist-test-slave-jlzn"
server_key: "34293bc3e7e86ca20fd2ac1b95c92b63"
server_key_iv: "4b5827ffa5cf5e444154525963e028e4"
server_key_version: "encryptionkey@0"
I20260810 01:44:28.052917 5498 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:44:28.055097 5516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:28.056236 5498 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:44:28.056326 5498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "1330bf3868bc421f862b7c34a1eb97dc"
format_stamp: "Formatted at 2026-08-10 01:44:28 on dist-test-slave-jlzn"
server_key: "34293bc3e7e86ca20fd2ac1b95c92b63"
server_key_iv: "4b5827ffa5cf5e444154525963e028e4"
server_key_version: "encryptionkey@0"
I20260810 01:44:28.056401 5498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:28.074617 5498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:28.077370 5498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:28.077507 5498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:28.077997 5498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:28.078716 5498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:28.078773 5498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:28.078811 5498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:28.078831 5498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:28.086869 5498 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:42137
I20260810 01:44:28.086889 5683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:42137 every 8 connection(s)
I20260810 01:44:28.087631 5498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:44:28.090855 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 5498
I20260810 01:44:28.090953 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:44:28.091181 16617 external_mini_cluster.cc:1428] Setting key 1e0311e9cdc2468825f88631bfe30149
Aug 10 01:44:28 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326268, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:28.099484 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.089236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:50021 (local address 127.16.58.126:38409)
0810 01:44:28.089368 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.089372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.090138 (+ 766us) server_negotiation.cc:407] Connection header received
0810 01:44:28.091452 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.091455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.091514 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.091583 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:28.092832 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.093478 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.094540 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.094741 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.094804 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.096852 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:28.096855 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:28.096857 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:28.096881 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:28.097971 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:28.098377 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:28.098379 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:28.098381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:28.098447 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:28.098687 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:28.098689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:28.098690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:28.098836 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:28.098924 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.099280 (+ 356us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.099370 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:44:28.100205 5687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.089600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:50021)
0810 01:44:28.090004 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:28.090042 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:28.091260 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:28.091773 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:28.091780 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:28.092204 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:28.092709 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.092724 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.093600 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.093603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.094446 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.094456 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.094840 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.094843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.094970 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.095361 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:28.095375 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:28.096712 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:28.098061 (+ 1349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:28.098066 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:28.098076 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:28.098305 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:28.098505 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:28.098507 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:28.098508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:28.098619 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:28.098921 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:28.098925 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:28.099113 (+ 188us) client_negotiation.cc:769] Sending connection context
0810 01:44:28.099247 (+ 134us) client_negotiation.cc:240] Negotiation successful
0810 01:44:28.099459 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":106,"threads_started":1}
I20260810 01:44:28.101156 5684 heartbeater.cc:347] Connected to a master server at 127.16.58.126:38409
I20260810 01:44:28.101351 5684 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:28.101763 5684 heartbeater.cc:511] Master 127.16.58.126:38409 requested a full tablet report, sending...
I20260810 01:44:28.102639 4987 ts_manager.cc:194] Registered new tserver with Master: 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137)
I20260810 01:44:28.103158 4987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:50021
I20260810 01:44:28.104763 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:44:28.112535 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.106596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58154 (local address 127.16.58.126:38409)
0810 01:44:28.106704 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.106707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.106903 (+ 196us) server_negotiation.cc:407] Connection header received
0810 01:44:28.107002 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.107004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.107037 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.107090 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:28.107677 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.108198 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.108936 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.109131 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.109191 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.110272 (+ 1081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:28.110274 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:28.110276 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:28.110290 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:28.111301 (+ 1011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:28.111643 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:28.111645 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:28.111646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:28.111706 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:28.111920 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:28.111922 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:28.111923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:28.112104 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:28.112216 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.112357 (+ 141us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.112435 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:44:28.114797 4987 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58154:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:44:28.117638 4987 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:44:28.131031 5705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.125895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40852 (local address 127.16.58.67:42137)
0810 01:44:28.126316 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.126327 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.127136 (+ 809us) server_negotiation.cc:407] Connection header received
0810 01:44:28.127236 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.127241 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.127403 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.127542 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:28.127738 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.128628 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.129885 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.130417 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.130511 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.130645 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.130816 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.130900 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":109,"threads_started":1}
I20260810 01:44:28.131021 5700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.125533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:42137 (local address 127.0.0.1:40852)
0810 01:44:28.127021 (+ 1488us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:28.127034 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:28.127141 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:28.127536 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:28.127539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:28.127558 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:28.127635 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.127640 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.128742 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.128745 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.129776 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.129786 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.130527 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.130531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.130644 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.130684 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 01:44:28.130777 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 01:44:28.130889 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1432,"mutex_wait_us":47,"thread_start_us":91,"threads_started":1}
I20260810 01:44:28.131569 5699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.125109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34837 (local address 127.0.0.1:54832)
0810 01:44:28.125759 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:28.125809 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:28.125932 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:28.126923 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:28.126927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:28.126946 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:28.127042 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.127048 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.128177 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.128180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.129787 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.129799 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.131035 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.131039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.131206 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.131245 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 01:44:28.131307 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 01:44:28.131428 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":207,"spinlock_wait_cycles":2688,"thread_start_us":62,"threads_started":1}
I20260810 01:44:28.131649 5701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.125238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54832 (local address 127.16.58.66:34837)
0810 01:44:28.126504 (+ 1266us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.126512 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.126530 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:44:28.126590 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.126595 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.126783 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.126933 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:28.127175 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.128055 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.129930 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.130746 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.130847 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.130971 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.131387 (+ 416us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.131481 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1172,"thread_start_us":150,"threads_started":1}
I20260810 01:44:28.131654 5703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.125844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54274 (local address 127.16.58.65:42003)
0810 01:44:28.126340 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.126349 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.126369 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:44:28.126436 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.126441 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.126636 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.126784 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:28.127062 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.128177 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.129929 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.130746 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.130848 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.130971 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.131409 (+ 438us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.131508 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":139,"threads_started":1}
I20260810 01:44:28.132009 5702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.125268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42003 (local address 127.0.0.1:54274)
0810 01:44:28.125759 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:28.125809 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:28.125933 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:28.126787 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:28.126792 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:28.126814 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:28.126927 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.126935 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.128314 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.128317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.129787 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.129799 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.131035 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.131039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.131203 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.131240 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 01:44:28.131307 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 01:44:28.131912 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":640,"spinlock_wait_cycles":6016,"thread_start_us":88,"threads_started":1}
I20260810 01:44:28.133982 5583 tablet_service.cc:1467] Processing CreateTablet for tablet 858d06fc71dc472a969c591610844b2d (DEFAULT_TABLE table=test-table [id=a75706075b36445785b9491f84d46630]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:28.134215 5184 tablet_service.cc:1467] Processing CreateTablet for tablet 858d06fc71dc472a969c591610844b2d (DEFAULT_TABLE table=test-table [id=a75706075b36445785b9491f84d46630]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:28.134915 5583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 858d06fc71dc472a969c591610844b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:28.135049 5184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 858d06fc71dc472a969c591610844b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:28.138320 5388 tablet_service.cc:1467] Processing CreateTablet for tablet 858d06fc71dc472a969c591610844b2d (DEFAULT_TABLE table=test-table [id=a75706075b36445785b9491f84d46630]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:28.139293 5388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 858d06fc71dc472a969c591610844b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:28.141580 5706 tablet_bootstrap.cc:492] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: Bootstrap starting.
I20260810 01:44:28.142561 5708 tablet_bootstrap.cc:492] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Bootstrap starting.
I20260810 01:44:28.143447 5706 tablet_bootstrap.cc:654] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:28.144548 5706 log.cc:824] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:28.145095 5708 tablet_bootstrap.cc:654] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:28.145953 5708 log.cc:824] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:28.146060 5711 tablet_bootstrap.cc:492] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: Bootstrap starting.
I20260810 01:44:28.146354 5706 tablet_bootstrap.cc:492] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: No bootstrap required, opened a new log
I20260810 01:44:28.146971 5706 ts_tablet_manager.cc:1397] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 01:44:28.147739 5708 tablet_bootstrap.cc:492] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: No bootstrap required, opened a new log
I20260810 01:44:28.147933 5708 ts_tablet_manager.cc:1397] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:44:28.148576 5711 tablet_bootstrap.cc:654] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:28.149362 5711 log.cc:824] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:28.150648 5706 raft_consensus.cc:348] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.150734 5708 raft_consensus.cc:348] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.150913 5708 raft_consensus.cc:374] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:28.150920 5706 raft_consensus.cc:374] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:28.150974 5706 raft_consensus.cc:729] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1330bf3868bc421f862b7c34a1eb97dc, State: Initialized, Role: FOLLOWER
I20260810 01:44:28.150988 5708 raft_consensus.cc:729] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2f3b6a47b4f4cc081351e4bfc6066a2, State: Initialized, Role: FOLLOWER
I20260810 01:44:28.151286 5711 tablet_bootstrap.cc:492] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: No bootstrap required, opened a new log
I20260810 01:44:28.151391 5708 consensus_queue.cc:260] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.151463 5711 ts_tablet_manager.cc:1397] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:44:28.151456 5706 consensus_queue.cc:260] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.152024 5277 heartbeater.cc:503] Master 127.16.58.126:38409 was elected leader, sending a full tablet report...
I20260810 01:44:28.152421 5708 ts_tablet_manager.cc:1428] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 01:44:28.152664 5706 ts_tablet_manager.cc:1428] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:44:28.152997 5684 heartbeater.cc:503] Master 127.16.58.126:38409 was elected leader, sending a full tablet report...
I20260810 01:44:28.154971 5711 raft_consensus.cc:348] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.155212 5711 raft_consensus.cc:374] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:28.155274 5711 raft_consensus.cc:729] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2cbdae9eed48f6bdf6e3e76967e425, State: Initialized, Role: FOLLOWER
I20260810 01:44:28.155659 5711 consensus_queue.cc:260] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.156355 5487 heartbeater.cc:503] Master 127.16.58.126:38409 was elected leader, sending a full tablet report...
I20260810 01:44:28.156533 5711 ts_tablet_manager.cc:1428] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260810 01:44:28.180743 5280 tablet.cc:2369] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:44:28.338528 5686 tablet.cc:2369] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:44:28.360188 5717 raft_consensus.cc:482] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:44:28.360390 5717 raft_consensus.cc:504] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.361529 5717 leader_election.cc:288] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837), d2f3b6a47b4f4cc081351e4bfc6066a2 (127.16.58.65:42003)
I20260810 01:44:28.365953 5703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.361862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:44695 (local address 127.16.58.65:42003)
0810 01:44:28.361976 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.361980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.362250 (+ 270us) server_negotiation.cc:407] Connection header received
0810 01:44:28.362353 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.362355 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.362400 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.362473 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:28.362694 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.363378 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.364747 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.365327 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.365440 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.365492 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.365747 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.365824 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:44:28.365952 5701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.361826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:52919 (local address 127.16.58.66:34837)
0810 01:44:28.361958 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.361963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.361979 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:44:28.362035 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.362037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.362089 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.362161 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:28.362456 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.363222 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.364720 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.365327 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.365440 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.365492 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.365748 (+ 256us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.365824 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:44:28.365994 5687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.361735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34837 (local address 127.16.58.67:52919)
0810 01:44:28.361851 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:28.361865 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:28.361950 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:28.362195 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:28.362198 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:28.362219 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:28.362354 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.362360 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.363320 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.363322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.364605 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.364617 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.365433 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.365436 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.365636 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.365654 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 01:44:28.365718 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 01:44:28.365834 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":98,"spinlock_wait_cycles":2304}
I20260810 01:44:28.366003 5721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.361750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42003 (local address 127.16.58.67:44695)
0810 01:44:28.362147 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:28.362159 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:28.362269 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:28.362489 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:28.362491 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:28.362508 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:28.362594 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.362597 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.363461 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.363464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.364643 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.364650 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.365432 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.365436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.365564 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.365645 (+ 81us) client_negotiation.cc:769] Sending connection context
0810 01:44:28.365722 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:44:28.365834 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":165,"spinlock_wait_cycles":1280,"thread_start_us":97,"threads_started":1}
I20260810 01:44:28.366596 5416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "858d06fc71dc472a969c591610844b2d" candidate_uuid: "1330bf3868bc421f862b7c34a1eb97dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" is_pre_election: true
I20260810 01:44:28.366794 5214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "858d06fc71dc472a969c591610844b2d" candidate_uuid: "1330bf3868bc421f862b7c34a1eb97dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" is_pre_election: true
I20260810 01:44:28.366882 5416 raft_consensus.cc:2454] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1330bf3868bc421f862b7c34a1eb97dc in term 0.
I20260810 01:44:28.367046 5214 raft_consensus.cc:2454] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1330bf3868bc421f862b7c34a1eb97dc in term 0.
I20260810 01:44:28.367323 5518 leader_election.cc:302] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2cbdae9eed48f6bdf6e3e76967e425, 1330bf3868bc421f862b7c34a1eb97dc; no voters:
I20260810 01:44:28.367554 5717 raft_consensus.cc:2781] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:44:28.367637 5717 raft_consensus.cc:482] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:44:28.367671 5717 raft_consensus.cc:3037] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:28.368708 5717 raft_consensus.cc:504] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.369017 5717 leader_election.cc:288] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [CANDIDATE]: Term 1 election: Requested vote from peers 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837), d2f3b6a47b4f4cc081351e4bfc6066a2 (127.16.58.65:42003)
I20260810 01:44:28.369310 5416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "858d06fc71dc472a969c591610844b2d" candidate_uuid: "1330bf3868bc421f862b7c34a1eb97dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425"
I20260810 01:44:28.369351 5214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "858d06fc71dc472a969c591610844b2d" candidate_uuid: "1330bf3868bc421f862b7c34a1eb97dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2"
I20260810 01:44:28.369417 5416 raft_consensus.cc:3037] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:28.369450 5214 raft_consensus.cc:3037] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:28.370386 5214 raft_consensus.cc:2454] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1330bf3868bc421f862b7c34a1eb97dc in term 1.
I20260810 01:44:28.370402 5416 raft_consensus.cc:2454] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1330bf3868bc421f862b7c34a1eb97dc in term 1.
I20260810 01:44:28.370640 5519 leader_election.cc:302] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1330bf3868bc421f862b7c34a1eb97dc, d2f3b6a47b4f4cc081351e4bfc6066a2; no voters:
I20260810 01:44:28.370812 5717 raft_consensus.cc:2781] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:44:28.370998 5717 raft_consensus.cc:686] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 1 LEADER]: Becoming Leader. State: Replica: 1330bf3868bc421f862b7c34a1eb97dc, State: Running, Role: LEADER
I20260810 01:44:28.371304 5717 consensus_queue.cc:237] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.374230 4984 catalog_manager.cc:5495] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67). New cstate: current_term: 1 leader_uuid: "1330bf3868bc421f862b7c34a1eb97dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } health_report { overall_health: HEALTHY } } }
W20260810 01:44:28.384732 5490 tablet.cc:2369] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:44:28.416908 5705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.413983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40856 (local address 127.16.58.67:42137)
0810 01:44:28.414098 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.414101 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.414113 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:44:28.414227 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.414229 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.414276 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.414357 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:44:28.414531 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.414998 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.415750 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.415987 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.416059 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.416272 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:44:28.416620 (+ 348us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:44:28.416702 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.416744 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.416790 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:44:28.422107 5416 raft_consensus.cc:1261] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 1 FOLLOWER]: Refusing update from remote peer 1330bf3868bc421f862b7c34a1eb97dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:28.422108 5214 raft_consensus.cc:1261] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Refusing update from remote peer 1330bf3868bc421f862b7c34a1eb97dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:28.422763 5725 consensus_queue.cc:1035] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:28.422925 5717 consensus_queue.cc:1035] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:28.430531 5731 mvcc.cc:205] Tried to move back new op lower bound from 7316792395450822656 to 7316792395251314688. Current Snapshot: MvccSnapshot[applied={T|T < 7316792395450822656}]
I20260810 01:44:28.436379 4984 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:44:28.436504 4984 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:44:28.438696 4984 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Sending DeleteTablet for 3 replicas of tablet 858d06fc71dc472a969c591610844b2d
I20260810 01:44:28.439355 5388 tablet_service.cc:1514] Processing DeleteTablet for tablet 858d06fc71dc472a969c591610844b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:28 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:54832
I20260810 01:44:28.439355 5184 tablet_service.cc:1514] Processing DeleteTablet for tablet 858d06fc71dc472a969c591610844b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:28 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:54274
I20260810 01:44:28.439853 5740 tablet_replica.cc:330] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: stopping tablet replica
I20260810 01:44:28.439940 5583 tablet_service.cc:1514] Processing DeleteTablet for tablet 858d06fc71dc472a969c591610844b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:28 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:40852
I20260810 01:44:28.440062 5739 tablet_replica.cc:330] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: stopping tablet replica
I20260810 01:44:28.440186 5740 raft_consensus.cc:2229] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:44:28.440318 5739 raft_consensus.cc:2229] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:44:28.440449 5740 raft_consensus.cc:2258] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:28.440469 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 5073
I20260810 01:44:28.448375 5739 raft_consensus.cc:2258] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:28.450350 5739 ts_tablet_manager.cc:1905] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:44:28.451412 5741 tablet_replica.cc:330] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: stopping tablet replica
I20260810 01:44:28.451778 5741 raft_consensus.cc:2229] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:44:28.452239 5741 raft_consensus.cc:2258] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:28.454421 5739 ts_tablet_manager.cc:1918] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:44:28.455320 5741 ts_tablet_manager.cc:1905] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:44:28.457317 5741 ts_tablet_manager.cc:1918] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:44:28.457417 5741 log.cc:1196] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/858d06fc71dc472a969c591610844b2d
I20260810 01:44:28.457702 5741 ts_tablet_manager.cc:1939] T 858d06fc71dc472a969c591610844b2d P 1330bf3868bc421f862b7c34a1eb97dc: Deleting consensus metadata
I20260810 01:44:28.458675 5739 log.cc:1196] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/858d06fc71dc472a969c591610844b2d
I20260810 01:44:28.458809 4964 catalog_manager.cc:4841] TS 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137): tablet 858d06fc71dc472a969c591610844b2d (table test-table [id=a75706075b36445785b9491f84d46630]) successfully deleted
I20260810 01:44:28.459020 5739 ts_tablet_manager.cc:1939] T 858d06fc71dc472a969c591610844b2d P 0c2cbdae9eed48f6bdf6e3e76967e425: Deleting consensus metadata
I20260810 01:44:28.460048 4961 catalog_manager.cc:4841] TS 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837): tablet 858d06fc71dc472a969c591610844b2d (table test-table [id=a75706075b36445785b9491f84d46630]) successfully deleted
W20260810 01:44:28.462095 4962 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:42003 (error 108)
I20260810 01:44:28.462957 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 5284
I20260810 01:44:28.463027 5700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.462777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42003 (local address 127.0.0.1:54284)
0810 01:44:28.462895 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:28.462954 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:42003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 01:44:28.464651 4962 catalog_manager.cc:4584] TS d2f3b6a47b4f4cc081351e4bfc6066a2 (127.16.58.65:42003): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 858d06fc71dc472a969c591610844b2d: Network error: Client connection negotiation failed: client connection to 127.16.58.65:42003: connect: Connection refused (error 111)
I20260810 01:44:28.490734 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 5498
I20260810 01:44:28.501897 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 4929
I20260810 01:44:28.512002 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38409
--webserver_interface=127.16.58.126
--webserver_port=35105
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:38409
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:28.617599 5745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:28.617828 5745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:28.617869 5745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:28.621763 5745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:28.621811 5745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:28.621831 5745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:28.621862 5745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:28.621887 5745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:28.626794 5745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:38409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=35105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:28.627672 5745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:28.628600 5745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:28.641316 5752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:28.641311 5753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:28.641438 5745 server_base.cc:1034] running on GCE node
W20260810 01:44:28.641332 5755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:28.642160 5745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:28.643198 5745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:28.644352 5745 hybrid_clock.cc:648] HybridClock initialized: now 1786326268644337 us; error 30 us; skew 500 ppm
Aug 10 01:44:28 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326268, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:28.646912 5745 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:44:28.647746 5745 webserver.cc:460] Webserver started at http://127.16.58.126:35105/ using document root <none> and password file <none>
I20260810 01:44:28.648294 5745 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:28.648379 5745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:28.652186 5745 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:44:28.654162 5767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:28.655236 5745 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:28.655350 5745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "05beece933c14328a2f61dadcc270d87"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "bc5c2f360f3c70159d3dd2a36f1a8eb7"
server_key_iv: "eb635fb300622ec248f7e933e74b626e"
server_key_version: "encryptionkey@0"
I20260810 01:44:28.655927 5745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:28.676555 5745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:28.679281 5745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:28.679441 5745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:28.685899 5745 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:38409
I20260810 01:44:28.686146 5848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:38409 every 8 connection(s)
I20260810 01:44:28.686883 5745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:44:28.687470 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 5745
I20260810 01:44:28.687896 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:42003
--local_ip_for_outbound_sockets=127.16.58.65
--tserver_master_addrs=127.16.58.126:38409
--webserver_port=45775
--webserver_interface=127.16.58.65
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:44:28.691649 5849 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:44:28.693819 5849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Bootstrap starting.
I20260810 01:44:28.716559 5849 log.cc:824] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:28.727037 5849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:44:28.727413 5849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Bootstrap complete.
I20260810 01:44:28.732792 5849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:28.733279 5849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05beece933c14328a2f61dadcc270d87, State: Initialized, Role: FOLLOWER
I20260810 01:44:28.733810 5849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:28.733955 5849 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:44:28.734040 5849 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:44:28.734139 5849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:44:28.736485 5849 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:28.736841 5849 leader_election.cc:302] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05beece933c14328a2f61dadcc270d87; no voters:
I20260810 01:44:28.737165 5849 leader_election.cc:288] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 01:44:28.737254 5855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:44:28.737491 5855 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 2 LEADER]: Becoming Leader. State: Replica: 05beece933c14328a2f61dadcc270d87, State: Running, Role: LEADER
I20260810 01:44:28.737828 5855 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:28.738340 5849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:28.739078 5856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "05beece933c14328a2f61dadcc270d87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } } }
I20260810 01:44:28.739200 5856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:28.739985 5868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:44:28.739943 5857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05beece933c14328a2f61dadcc270d87. Latest consensus state: current_term: 2 leader_uuid: "05beece933c14328a2f61dadcc270d87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } } }
I20260810 01:44:28.740338 5857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:28.744326 5868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:44:28.744976 5868 catalog_manager.cc:1259] Loaded cluster ID: ea33e1eca17746b6bbd8f0dcccd335c5
I20260810 01:44:28.745030 5868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:44:28.746119 5868 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 01:44:28.748956 5868 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 01:44:28.753382 5868 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:44:28.753975 5868 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Loaded TSK: 0
I20260810 01:44:28.754871 5868 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:44:28.824074 5853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:28.824343 5853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:28.824409 5853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:28.828285 5853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:28.828336 5853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:28.828408 5853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:44:28.833364 5853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:42003
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=45775
--tserver_master_addrs=127.16.58.126:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:28.834270 5853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:28.835207 5853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:28.844592 5887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:28.844605 5886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:28.844832 5889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:28.845034 5853 server_base.cc:1034] running on GCE node
I20260810 01:44:28.845408 5853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:28.845979 5853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:28.847153 5853 hybrid_clock.cc:648] HybridClock initialized: now 1786326268847133 us; error 34 us; skew 500 ppm
Aug 10 01:44:28 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326268, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:28.849714 5853 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:44:28.850558 5853 webserver.cc:460] Webserver started at http://127.16.58.65:45775/ using document root <none> and password file <none>
I20260810 01:44:28.851070 5853 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:28.851145 5853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:28.854744 5853 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:28.856706 5897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:28.857847 5853 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:28.857946 5853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "90a80720f88ece3f0dc109e6c64d817c"
server_key_iv: "c8b3209419dce6bdb220a536429c3af2"
server_key_version: "encryptionkey@0"
I20260810 01:44:28.858474 5853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:28.883652 5853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:28.886545 5853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:28.886736 5853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:28.887329 5853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:28.888577 5909 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 01:44:28.893261 5853 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 01:44:28.893319 5853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260810 01:44:28.893374 5853 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 01:44:28.894944 5853 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 01:44:28.894989 5853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 01:44:28.895287 5909 tablet_bootstrap.cc:492] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Bootstrap starting.
I20260810 01:44:28.904476 5853 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:42003
I20260810 01:44:28.904567 6071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:42003 every 8 connection(s)
I20260810 01:44:28.905400 5853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:44:28.913887 5909 log.cc:824] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:28.915592 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 5853
Aug 10 01:44:28 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326268, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:28.916034 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:34837
--local_ip_for_outbound_sockets=127.16.58.66
--tserver_master_addrs=127.16.58.126:38409
--webserver_port=42959
--webserver_interface=127.16.58.66
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:44:28.921572 5909 tablet_bootstrap.cc:492] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:44:28.922016 5909 tablet_bootstrap.cc:492] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Bootstrap complete.
I20260810 01:44:28.922150 6077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.907189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:38621)
0810 01:44:28.907780 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:28.907869 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:28.908896 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:28.909979 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:28.909997 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:28.910490 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:28.911168 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.911187 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.912490 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.912494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.913388 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.913398 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.914098 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.914103 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.914304 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.914825 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:28.914841 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:28.916508 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:28.918778 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:28.918784 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:28.918795 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:28.919116 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:28.919547 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:28.919550 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:28.919552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:28.919717 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:28.920397 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:28.920402 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:28.920657 (+ 255us) client_negotiation.cc:769] Sending connection context
0810 01:44:28.920876 (+ 219us) client_negotiation.cc:240] Negotiation successful
0810 01:44:28.921186 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":154,"threads_started":1}
I20260810 01:44:28.922176 6080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.907310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:38621 (local address 127.16.58.126:38409)
0810 01:44:28.907791 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.907831 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.908155 (+ 324us) server_negotiation.cc:407] Connection header received
0810 01:44:28.909321 (+ 1166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.909332 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.909595 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.909851 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:28.911331 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.912316 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.913505 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.913951 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.914092 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.916715 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:28.916721 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:28.916736 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:28.916767 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:28.918648 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:28.919254 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:28.919260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:28.919266 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:28.919424 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:28.919837 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:28.919841 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:28.919842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:28.920275 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:28.920405 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.921014 (+ 609us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.921341 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":113,"threads_started":1}
I20260810 01:44:28.923434 5909 ts_tablet_manager.cc:1397] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Time spent bootstrapping tablet: real 0.028s user 0.019s sys 0.008s
I20260810 01:44:28.926510 6073 heartbeater.cc:347] Connected to a master server at 127.16.58.126:38409
I20260810 01:44:28.926224 5909 raft_consensus.cc:348] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.926710 5909 raft_consensus.cc:729] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2f3b6a47b4f4cc081351e4bfc6066a2, State: Initialized, Role: FOLLOWER
I20260810 01:44:28.926718 6073 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:28.927184 5909 consensus_queue.cc:260] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } } peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } }
I20260810 01:44:28.927367 6073 heartbeater.cc:511] Master 127.16.58.126:38409 requested a full tablet report, sending...
I20260810 01:44:28.928076 5909 ts_tablet_manager.cc:1428] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:44:28.929908 5792 ts_manager.cc:194] Registered new tserver with Master: d2f3b6a47b4f4cc081351e4bfc6066a2 (127.16.58.65:42003)
I20260810 01:44:28.933482 5792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:38621
I20260810 01:44:28.936015 6073 heartbeater.cc:503] Master 127.16.58.126:38409 was elected leader, sending a full tablet report...
Aug 10 01:44:28 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326268, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.65@KRBTEST.COM
I20260810 01:44:28.943871 6086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.932776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54296 (local address 127.16.58.65:42003)
0810 01:44:28.933375 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:28.933386 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:28.933407 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:44:28.933467 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:28.933472 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:28.933653 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:28.933778 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:28.935911 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.936775 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.937973 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.938340 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.938417 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.940749 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:28.940758 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:28.940766 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:28.940788 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:28.942170 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:28.942663 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:28.942667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:28.942668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:28.942742 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:28.942986 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:28.942987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:28.942989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:28.943186 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:28.943279 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:28.943596 (+ 317us) server_negotiation.cc:299] Negotiation successful
0810 01:44:28.943725 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":86,"threads_started":1}
I20260810 01:44:28.943908 6084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:28.932707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42003 (local address 127.0.0.1:54296)
0810 01:44:28.933064 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:28.933108 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:28.933223 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:28.933803 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:28.933808 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:28.934205 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:28.934328 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.934336 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.936875 (+ 2539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.936878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.937860 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:28.937872 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:28.938448 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:28.938452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:28.938567 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:28.939105 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:28.939119 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:28.940623 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:28.942267 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:28.942277 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:28.942283 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:28.942566 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:28.942815 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:28.942818 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:28.942820 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:28.942913 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:28.943281 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:28.943287 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:28.943404 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 01:44:28.943544 (+ 140us) client_negotiation.cc:240] Negotiation successful
0810 01:44:28.943720 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":88,"threads_started":1}
I20260810 01:44:28.944901 5970 tablet_service.cc:1514] Processing DeleteTablet for tablet 858d06fc71dc472a969c591610844b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:28 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:54296
I20260810 01:44:28.945766 6088 tablet_replica.cc:330] stopping tablet replica
I20260810 01:44:28.946019 6088 raft_consensus.cc:2229] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:44:28.946228 6088 raft_consensus.cc:2258] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:28.947052 6088 ts_tablet_manager.cc:1905] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:44:28.950294 6088 ts_tablet_manager.cc:1918] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:44:28.950381 6088 log.cc:1196] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/858d06fc71dc472a969c591610844b2d
I20260810 01:44:28.950609 6088 ts_tablet_manager.cc:1939] T 858d06fc71dc472a969c591610844b2d P d2f3b6a47b4f4cc081351e4bfc6066a2: Deleting consensus metadata
I20260810 01:44:28.952173 5770 catalog_manager.cc:4841] TS d2f3b6a47b4f4cc081351e4bfc6066a2 (127.16.58.65:42003): tablet 858d06fc71dc472a969c591610844b2d (table test-table [id=a75706075b36445785b9491f84d46630]) successfully deleted
W20260810 01:44:29.032016 6082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:29.032234 6082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:29.032271 6082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:29.036052 6082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:29.036094 6082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:29.036145 6082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:44:29.041193 6082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:34837
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=42959
--tserver_master_addrs=127.16.58.126:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:29.042094 6082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:29.043012 6082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:29.051913 6098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:29.051950 6095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:29.051975 6082 server_base.cc:1034] running on GCE node
W20260810 01:44:29.052037 6094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:29.052428 6082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:29.053020 6082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:29.054167 6082 hybrid_clock.cc:648] HybridClock initialized: now 1786326269054150 us; error 30 us; skew 500 ppm
Aug 10 01:44:29 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326269, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:29.056710 6082 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:44:29.057442 6082 webserver.cc:460] Webserver started at http://127.16.58.66:42959/ using document root <none> and password file <none>
I20260810 01:44:29.057912 6082 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:29.057983 6082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:29.061539 6082 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:44:29.063452 6107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:29.064546 6082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:29.064652 6082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "0c2cbdae9eed48f6bdf6e3e76967e425"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "46120f27782a0c43655ff25573bf525b"
server_key_iv: "ec11ec70d5979c2f8a7a47a706a46d91"
server_key_version: "encryptionkey@0"
I20260810 01:44:29.065114 6082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:29.073211 6082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:29.075927 6082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:29.076076 6082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:29.076566 6082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:29.077294 6082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:29.077340 6082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:29.077379 6082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:29.077409 6082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:29.085214 6082 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:34837
I20260810 01:44:29.085273 6283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:34837 every 8 connection(s)
I20260810 01:44:29.086073 6082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:44:29.093636 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 6082
I20260810 01:44:29.094005 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:42137
--local_ip_for_outbound_sockets=127.16.58.67
--tserver_master_addrs=127.16.58.126:38409
--webserver_port=37941
--webserver_interface=127.16.58.67
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:44:29 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326269, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:29.098338 6080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.087608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:51267 (local address 127.16.58.126:38409)
0810 01:44:29.087751 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:29.087756 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:29.088548 (+ 792us) server_negotiation.cc:407] Connection header received
0810 01:44:29.089776 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:29.089779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:29.089829 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:29.089901 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:29.090911 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.091445 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.092540 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.092767 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.092845 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.095004 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:29.095007 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:29.095010 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:29.095038 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:29.096426 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:29.096978 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:29.096980 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:29.096981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:29.097049 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:29.097378 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:29.097380 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:29.097381 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:29.097541 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:29.097610 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:29.098113 (+ 503us) server_negotiation.cc:299] Negotiation successful
0810 01:44:29.098213 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:44:29.099300 6287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.088016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:51267)
0810 01:44:29.088409 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:29.088448 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:29.089601 (+ 1153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:29.090033 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:29.090040 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:29.090370 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:29.090782 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.090794 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.091549 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.091551 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.092443 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.092453 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.092874 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.092877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.093003 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.093447 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:29.093462 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:29.094841 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:29.096537 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:29.096543 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:29.096556 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:29.096892 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:29.097121 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:29.097124 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:29.097126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:29.097294 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:29.097639 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:29.097645 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:29.097902 (+ 257us) client_negotiation.cc:769] Sending connection context
0810 01:44:29.098079 (+ 177us) client_negotiation.cc:240] Negotiation successful
0810 01:44:29.098361 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":98,"threads_started":1}
I20260810 01:44:29.100405 6284 heartbeater.cc:347] Connected to a master server at 127.16.58.126:38409
I20260810 01:44:29.100610 6284 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:29.101025 6284 heartbeater.cc:511] Master 127.16.58.126:38409 requested a full tablet report, sending...
I20260810 01:44:29.102018 5792 ts_manager.cc:194] Registered new tserver with Master: 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837)
I20260810 01:44:29.102548 5792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:51267
W20260810 01:44:29.202447 6288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:29.202682 6288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:29.202739 6288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:29.206694 6288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:29.206748 6288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:29.206822 6288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:44:29.211788 6288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:42137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=37941
--tserver_master_addrs=127.16.58.126:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:29.212706 6288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:29.213606 6288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:29.222541 6295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:29.222524 6298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:29.222627 6288 server_base.cc:1034] running on GCE node
W20260810 01:44:29.222518 6296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:29.223201 6288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:29.223747 6288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:29.224923 6288 hybrid_clock.cc:648] HybridClock initialized: now 1786326269224902 us; error 30 us; skew 500 ppm
Aug 10 01:44:29 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326269, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:29.227399 6288 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:44:29.228202 6288 webserver.cc:460] Webserver started at http://127.16.58.67:37941/ using document root <none> and password file <none>
I20260810 01:44:29.228677 6288 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:29.228752 6288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:29.232236 6288 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:44:29.234104 6311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:29.235203 6288 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:29.235302 6288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "1330bf3868bc421f862b7c34a1eb97dc"
format_stamp: "Formatted at 2026-08-10 01:44:28 on dist-test-slave-jlzn"
server_key: "34293bc3e7e86ca20fd2ac1b95c92b63"
server_key_iv: "4b5827ffa5cf5e444154525963e028e4"
server_key_version: "encryptionkey@0"
I20260810 01:44:29.235790 6288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:29.250950 6288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:29.253456 6288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:29.253609 6288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:29.254122 6288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:29.254858 6288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:29.254904 6288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:29.254954 6288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:29.254987 6288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:29.263121 6288 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:42137
I20260810 01:44:29.263170 6478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:42137 every 8 connection(s)
I20260810 01:44:29.264014 6288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:44:29.271085 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 6288
Aug 10 01:44:29 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326269, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:29.276772 6080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.265596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:41715 (local address 127.16.58.126:38409)
0810 01:44:29.265734 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:29.265737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:29.266470 (+ 733us) server_negotiation.cc:407] Connection header received
0810 01:44:29.267764 (+ 1294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:29.267767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:29.267854 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:29.267931 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:29.269030 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.269540 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.270617 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.270834 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.270921 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.273546 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:29.273550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:29.273551 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:29.273574 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:29.274914 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:29.275357 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:29.275361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:29.275363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:29.275441 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:29.275746 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:29.275749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:29.275751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:29.275959 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:29.276045 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:29.276500 (+ 455us) server_negotiation.cc:299] Negotiation successful
0810 01:44:29.276616 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 01:44:29.277489 6485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.265927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:41715)
0810 01:44:29.266339 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:29.266378 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:29.267562 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:29.268093 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:29.268099 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:29.268430 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:29.268894 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.268906 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.269659 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.269662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.270501 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.270510 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.270967 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.270971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.271124 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.271656 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:29.271675 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:29.273400 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:29.275011 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:29.275016 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:29.275029 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:29.275265 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:29.275521 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:29.275524 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:29.275526 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:29.275659 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:29.276054 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:29.276060 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:29.276269 (+ 209us) client_negotiation.cc:769] Sending connection context
0810 01:44:29.276423 (+ 154us) client_negotiation.cc:240] Negotiation successful
0810 01:44:29.276712 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":102,"threads_started":1}
I20260810 01:44:29.278534 6479 heartbeater.cc:347] Connected to a master server at 127.16.58.126:38409
I20260810 01:44:29.278764 6479 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:29.279284 6479 heartbeater.cc:511] Master 127.16.58.126:38409 requested a full tablet report, sending...
I20260810 01:44:29.279317 6489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.271718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58166 (local address 127.16.58.126:38409)
0810 01:44:29.271993 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:29.271998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:29.272056 (+ 58us) server_negotiation.cc:407] Connection header received
0810 01:44:29.272180 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:29.272184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:29.272231 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:29.272329 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:29.273157 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.273647 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.274770 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.274983 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.275074 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.276293 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:29.276296 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:29.276298 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:29.276319 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:29.277746 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:29.278153 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:29.278157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:29.278158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:29.278246 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:29.278515 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:29.278518 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:29.278519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:29.278725 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:29.278925 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:29.279055 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 01:44:29.279170 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":113,"threads_started":1}
I20260810 01:44:29.280298 5792 ts_manager.cc:194] Registered new tserver with Master: 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137)
I20260810 01:44:29.280941 5792 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:41715
I20260810 01:44:29.280999 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:44:29.284771 6489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.281523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58178 (local address 127.16.58.126:38409)
0810 01:44:29.281639 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:29.281643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:29.281822 (+ 179us) server_negotiation.cc:407] Connection header received
0810 01:44:29.281948 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:29.281951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:29.282034 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:29.282113 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:44:29.282326 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.282780 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.283564 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.283784 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.283894 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.284161 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:44:29.284450 (+ 289us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:44:29.284546 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:29.284615 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 01:44:29.284666 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:44:29.285364 5792 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:58178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:44:29.288293 5792 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:44:29.295217 5970 tablet_service.cc:1467] Processing CreateTablet for tablet b257f06d6583447399e869f33a7cd259 (DEFAULT_TABLE table=test-table [id=7c8313ed26c7435aa8ac69f084f2cece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:29.295871 5970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b257f06d6583447399e869f33a7cd259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:29.298533 5909 tablet_bootstrap.cc:492] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Bootstrap starting.
I20260810 01:44:29.299391 5909 tablet_bootstrap.cc:654] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:29.299417 6500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.294484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34837 (local address 127.0.0.1:54842)
0810 01:44:29.294874 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:29.294886 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:29.294968 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:29.295573 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:29.295576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:29.295595 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:29.295687 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.295694 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.297057 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.297060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.297920 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.297931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.298979 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.298983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.299085 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.299140 (+ 55us) client_negotiation.cc:769] Sending connection context
0810 01:44:29.299216 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 01:44:29.299283 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":36,"thread_start_us":96,"threads_started":1}
I20260810 01:44:29.299682 6501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.294901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54842 (local address 127.16.58.66:34837)
0810 01:44:29.295215 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:29.295224 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:29.295241 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:44:29.295299 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:29.295302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:29.295452 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:29.295585 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:29.295782 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.296803 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.298032 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.298859 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.298966 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.299101 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:29.299332 (+ 231us) server_negotiation.cc:299] Negotiation successful
0810 01:44:29.299427 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":119,"threads_started":1}
I20260810 01:44:29.300067 6084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.294223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:42137 (local address 127.0.0.1:40858)
0810 01:44:29.294315 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:29.294329 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:29.294397 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:29.295206 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:29.295209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:29.295229 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:29.295309 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.295315 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.296743 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.296747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.297945 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.297955 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.299661 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.299665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.299764 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.299786 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:44:29.299884 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 01:44:29.299957 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":71}
I20260810 01:44:29.300148 6498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.294462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40858 (local address 127.16.58.67:42137)
0810 01:44:29.294760 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:29.294771 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:29.294790 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:44:29.294851 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:29.294856 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:29.295035 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:29.295457 (+ 422us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:29.295578 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.296588 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.298072 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.298859 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.298966 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.299249 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:29.299918 (+ 669us) server_negotiation.cc:299] Negotiation successful
0810 01:44:29.300011 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":110,"threads_started":1}
I20260810 01:44:29.302330 6385 tablet_service.cc:1467] Processing CreateTablet for tablet b257f06d6583447399e869f33a7cd259 (DEFAULT_TABLE table=test-table [id=7c8313ed26c7435aa8ac69f084f2cece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:29.302316 6194 tablet_service.cc:1467] Processing CreateTablet for tablet b257f06d6583447399e869f33a7cd259 (DEFAULT_TABLE table=test-table [id=7c8313ed26c7435aa8ac69f084f2cece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:29.303265 6194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b257f06d6583447399e869f33a7cd259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:29.303282 6385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b257f06d6583447399e869f33a7cd259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:29.305845 5909 tablet_bootstrap.cc:492] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: No bootstrap required, opened a new log
I20260810 01:44:29.305944 5909 ts_tablet_manager.cc:1397] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 01:44:29.306435 5909 raft_consensus.cc:348] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:29.306560 5909 raft_consensus.cc:374] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:29.306608 5909 raft_consensus.cc:729] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2f3b6a47b4f4cc081351e4bfc6066a2, State: Initialized, Role: FOLLOWER
I20260810 01:44:29.306746 5909 consensus_queue.cc:260] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:29.308019 5909 ts_tablet_manager.cc:1428] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:29.309893 6509 tablet_bootstrap.cc:492] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: Bootstrap starting.
I20260810 01:44:29.310775 6510 tablet_bootstrap.cc:492] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: Bootstrap starting.
I20260810 01:44:29.312135 6509 tablet_bootstrap.cc:654] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:29.312832 6510 tablet_bootstrap.cc:654] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:29.312865 6509 log.cc:824] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:29.313553 6510 log.cc:824] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:29.314522 6509 tablet_bootstrap.cc:492] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: No bootstrap required, opened a new log
I20260810 01:44:29.314697 6509 ts_tablet_manager.cc:1397] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:44:29.315069 6510 tablet_bootstrap.cc:492] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: No bootstrap required, opened a new log
I20260810 01:44:29.315236 6510 ts_tablet_manager.cc:1397] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:44:29.317392 6509 raft_consensus.cc:348] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:29.317577 6509 raft_consensus.cc:374] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:29.317610 6509 raft_consensus.cc:729] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1330bf3868bc421f862b7c34a1eb97dc, State: Initialized, Role: FOLLOWER
I20260810 01:44:29.317840 6510 raft_consensus.cc:348] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:29.317971 6509 consensus_queue.cc:260] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:29.318048 6510 raft_consensus.cc:374] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:29.318120 6510 raft_consensus.cc:729] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2cbdae9eed48f6bdf6e3e76967e425, State: Initialized, Role: FOLLOWER
I20260810 01:44:29.318554 6510 consensus_queue.cc:260] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:29.318679 6479 heartbeater.cc:503] Master 127.16.58.126:38409 was elected leader, sending a full tablet report...
I20260810 01:44:29.318881 6509 ts_tablet_manager.cc:1428] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: Time spent starting tablet: real 0.004s user 0.001s sys 0.004s
I20260810 01:44:29.319252 6284 heartbeater.cc:503] Master 127.16.58.126:38409 was elected leader, sending a full tablet report...
I20260810 01:44:29.319509 6510 ts_tablet_manager.cc:1428] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260810 01:44:29.336863 6286 tablet.cc:2369] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:44:29.406533 6076 tablet.cc:2369] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:44:29.503021 6514 raft_consensus.cc:482] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:44:29.503235 6514 raft_consensus.cc:504] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:29.504379 6514 leader_election.cc:288] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137), d2f3b6a47b4f4cc081351e4bfc6066a2 (127.16.58.65:42003)
I20260810 01:44:29.508342 6287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.504578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:42137 (local address 127.16.58.66:49779)
0810 01:44:29.504807 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:29.504823 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:29.504913 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:29.505206 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:29.505209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:29.505225 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:29.505358 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.505365 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.506342 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.506345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.507231 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.507242 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.507911 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.507914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.508019 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.508041 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:44:29.508111 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:44:29.508195 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":69}
I20260810 01:44:29.508353 6498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.504742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:49779 (local address 127.16.58.67:42137)
0810 01:44:29.504865 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:29.504870 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:29.504886 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:44:29.505050 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:29.505053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:29.505100 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:29.505182 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:29.505475 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.506251 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.507368 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.507792 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.507903 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.507945 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:29.508152 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 01:44:29.508231 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:44:29.508378 6515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.504610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42003 (local address 127.16.58.66:52647)
0810 01:44:29.505050 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:29.505061 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:29.505149 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:29.505419 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:29.505422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:29.505441 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:29.505538 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.505545 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.506480 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.506484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.507288 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:29.507299 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.508020 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.508023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:29.508106 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.508139 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 01:44:29.508190 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 01:44:29.508253 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":1,"thread_start_us":117,"threads_started":1}
I20260810 01:44:29.508404 6516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.504726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:52647 (local address 127.16.58.65:42003)
0810 01:44:29.505033 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:29.505037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:29.505126 (+ 89us) server_negotiation.cc:407] Connection header received
0810 01:44:29.505246 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:29.505249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:29.505311 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:29.505396 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:29.505656 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.506370 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.507402 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.507898 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.508012 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.508171 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:29.508221 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 01:44:29.508293 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":106,"threads_started":1}
I20260810 01:44:29.508965 6005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b257f06d6583447399e869f33a7cd259" candidate_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" is_pre_election: true
I20260810 01:44:29.509145 6414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b257f06d6583447399e869f33a7cd259" candidate_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1330bf3868bc421f862b7c34a1eb97dc" is_pre_election: true
I20260810 01:44:29.509286 6005 raft_consensus.cc:2454] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2cbdae9eed48f6bdf6e3e76967e425 in term 0.
I20260810 01:44:29.509404 6414 raft_consensus.cc:2454] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2cbdae9eed48f6bdf6e3e76967e425 in term 0.
I20260810 01:44:29.509737 6110 leader_election.cc:302] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2cbdae9eed48f6bdf6e3e76967e425, d2f3b6a47b4f4cc081351e4bfc6066a2; no voters:
I20260810 01:44:29.509972 6514 raft_consensus.cc:2781] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:44:29.510053 6514 raft_consensus.cc:482] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:44:29.510085 6514 raft_consensus.cc:3037] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:29.511080 6514 raft_consensus.cc:504] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:29.511399 6514 leader_election.cc:288] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [CANDIDATE]: Term 1 election: Requested vote from peers 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137), d2f3b6a47b4f4cc081351e4bfc6066a2 (127.16.58.65:42003)
I20260810 01:44:29.511725 6414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b257f06d6583447399e869f33a7cd259" candidate_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1330bf3868bc421f862b7c34a1eb97dc"
I20260810 01:44:29.511759 6005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b257f06d6583447399e869f33a7cd259" candidate_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2"
I20260810 01:44:29.511858 6414 raft_consensus.cc:3037] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:29.511904 6005 raft_consensus.cc:3037] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:29.512776 6005 raft_consensus.cc:2454] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2cbdae9eed48f6bdf6e3e76967e425 in term 1.
I20260810 01:44:29.512833 6414 raft_consensus.cc:2454] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2cbdae9eed48f6bdf6e3e76967e425 in term 1.
I20260810 01:44:29.513096 6112 leader_election.cc:302] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0c2cbdae9eed48f6bdf6e3e76967e425, 1330bf3868bc421f862b7c34a1eb97dc, d2f3b6a47b4f4cc081351e4bfc6066a2; no voters:
I20260810 01:44:29.513262 6514 raft_consensus.cc:2781] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:44:29.513460 6514 raft_consensus.cc:686] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 1 LEADER]: Becoming Leader. State: Replica: 0c2cbdae9eed48f6bdf6e3e76967e425, State: Running, Role: LEADER
I20260810 01:44:29.513779 6514 consensus_queue.cc:237] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
W20260810 01:44:29.514815 6483 tablet.cc:2369] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:44:29.516914 5790 catalog_manager.cc:5495] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } health_report { overall_health: UNKNOWN } } }
I20260810 01:44:29.531651 6501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.528474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54856 (local address 127.16.58.66:34837)
0810 01:44:29.528582 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:29.528586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:29.528612 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:44:29.528766 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:29.528769 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:29.528815 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:29.528896 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:44:29.529114 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.529594 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.530378 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:29.530578 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:29.530658 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:29.530928 (+ 270us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:44:29.531286 (+ 358us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:44:29.531384 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:29.531454 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 01:44:29.531515 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:44:29.536610 6414 raft_consensus.cc:1261] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [term 1 FOLLOWER]: Refusing update from remote peer 0c2cbdae9eed48f6bdf6e3e76967e425: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:29.536612 6005 raft_consensus.cc:1261] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Refusing update from remote peer 0c2cbdae9eed48f6bdf6e3e76967e425: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:29.537266 6518 consensus_queue.cc:1035] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:29.537426 6514 consensus_queue.cc:1035] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:29.543829 6524 mvcc.cc:205] Tried to move back new op lower bound from 7316792400015732736 to 7316792399930609664. Current Snapshot: MvccSnapshot[applied={T|T < 7316792400015732736 or (T in {7316792400015732736})}]
I20260810 01:44:29.550770 5790 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:58178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:44:29.550891 5790 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:58178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:44:29.553051 5790 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Sending DeleteTablet for 3 replicas of tablet b257f06d6583447399e869f33a7cd259
I20260810 01:44:29.553644 5970 tablet_service.cc:1514] Processing DeleteTablet for tablet b257f06d6583447399e869f33a7cd259 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:29 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:54296
I20260810 01:44:29.553653 6385 tablet_service.cc:1514] Processing DeleteTablet for tablet b257f06d6583447399e869f33a7cd259 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:29 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:40858
I20260810 01:44:29.553742 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 5853
I20260810 01:44:29.553699 6194 tablet_service.cc:1514] Processing DeleteTablet for tablet b257f06d6583447399e869f33a7cd259 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:29 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:54842
I20260810 01:44:29.557770 6541 tablet_replica.cc:330] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: stopping tablet replica
I20260810 01:44:29.558030 6541 raft_consensus.cc:2229] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:44:29.558290 6541 raft_consensus.cc:2258] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:29.558620 6540 tablet_replica.cc:330] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: stopping tablet replica
I20260810 01:44:29.558861 6540 raft_consensus.cc:2229] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:44:29.559082 6540 raft_consensus.cc:2258] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:29.561133 6540 ts_tablet_manager.cc:1905] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:44:29.562817 6541 ts_tablet_manager.cc:1905] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:44:29.565161 6541 ts_tablet_manager.cc:1918] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:44:29.565287 6541 log.cc:1196] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/b257f06d6583447399e869f33a7cd259
I20260810 01:44:29.565675 6541 ts_tablet_manager.cc:1939] T b257f06d6583447399e869f33a7cd259 P 0c2cbdae9eed48f6bdf6e3e76967e425: Deleting consensus metadata
I20260810 01:44:29.565963 6540 ts_tablet_manager.cc:1918] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:44:29.566138 6540 log.cc:1196] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/b257f06d6583447399e869f33a7cd259
I20260810 01:44:29.566613 6540 ts_tablet_manager.cc:1939] T b257f06d6583447399e869f33a7cd259 P 1330bf3868bc421f862b7c34a1eb97dc: Deleting consensus metadata
I20260810 01:44:29.566979 5769 catalog_manager.cc:4841] TS 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837): tablet b257f06d6583447399e869f33a7cd259 (table test-table [id=7c8313ed26c7435aa8ac69f084f2cece]) successfully deleted
I20260810 01:44:29.568316 5772 catalog_manager.cc:4841] TS 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137): tablet b257f06d6583447399e869f33a7cd259 (table test-table [id=7c8313ed26c7435aa8ac69f084f2cece]) successfully deleted
I20260810 01:44:29.580483 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 6082
W20260810 01:44:29.580482 5770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:42003 (error 108)
I20260810 01:44:29.585389 6084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:29.585077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42003 (local address 127.0.0.1:54298)
0810 01:44:29.585252 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:29.585307 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:42003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
W20260810 01:44:29.585533 5770 catalog_manager.cc:4584] TS d2f3b6a47b4f4cc081351e4bfc6066a2 (127.16.58.65:42003): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b257f06d6583447399e869f33a7cd259: Network error: Client connection negotiation failed: client connection to 127.16.58.65:42003: connect: Connection refused (error 111)
I20260810 01:44:29.592211 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 6288
I20260810 01:44:29.600384 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 5745
I20260810 01:44:29.612174 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38409
--webserver_interface=127.16.58.126
--webserver_port=35105
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:38409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:29.718201 6544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:29.718431 6544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:29.718472 6544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:29.722365 6544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:29.722415 6544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:29.722434 6544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:29.722462 6544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:29.722488 6544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:29.727444 6544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:38409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=35105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:29.728344 6544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:29.729265 6544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:29.737051 6549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:29.737109 6552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:29.737133 6555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:29.737197 6544 server_base.cc:1034] running on GCE node
I20260810 01:44:29.737812 6544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:29.738765 6544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:29.739866 6544 hybrid_clock.cc:648] HybridClock initialized: now 1786326269739849 us; error 27 us; skew 500 ppm
Aug 10 01:44:29 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326269, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:29.742388 6544 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:44:29.743201 6544 webserver.cc:460] Webserver started at http://127.16.58.126:35105/ using document root <none> and password file <none>
I20260810 01:44:29.743687 6544 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:29.743747 6544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:29.747208 6544 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:44:29.749220 6566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:29.750314 6544 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:44:29.750424 6544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "05beece933c14328a2f61dadcc270d87"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "bc5c2f360f3c70159d3dd2a36f1a8eb7"
server_key_iv: "eb635fb300622ec248f7e933e74b626e"
server_key_version: "encryptionkey@0"
I20260810 01:44:29.750914 6544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:29.764581 6544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:29.767005 6544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:29.767177 6544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:29.773909 6544 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:38409
I20260810 01:44:29.774209 6646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:38409 every 8 connection(s)
I20260810 01:44:29.774976 6544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:44:29.777917 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 6544
I20260810 01:44:29.778311 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:42003
--local_ip_for_outbound_sockets=127.16.58.65
--tserver_master_addrs=127.16.58.126:38409
--webserver_port=45775
--webserver_interface=127.16.58.65
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:44:29.779111 6647 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:44:29.781023 6647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Bootstrap starting.
I20260810 01:44:29.798084 6647 log.cc:824] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:29.809105 6647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:44:29.809433 6647 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87: Bootstrap complete.
I20260810 01:44:29.813287 6647 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:29.813654 6647 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05beece933c14328a2f61dadcc270d87, State: Initialized, Role: FOLLOWER
I20260810 01:44:29.814090 6647 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:29.814217 6647 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:44:29.814286 6647 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:44:29.814383 6647 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 2 FOLLOWER]: Advancing to term 3
I20260810 01:44:29.816135 6647 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:29.816444 6647 leader_election.cc:302] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05beece933c14328a2f61dadcc270d87; no voters:
I20260810 01:44:29.816735 6647 leader_election.cc:288] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 01:44:29.816828 6651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 01:44:29.817000 6651 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [term 3 LEADER]: Becoming Leader. State: Replica: 05beece933c14328a2f61dadcc270d87, State: Running, Role: LEADER
I20260810 01:44:29.817281 6651 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } }
I20260810 01:44:29.817909 6647 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:29.818171 6651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05beece933c14328a2f61dadcc270d87. Latest consensus state: current_term: 3 leader_uuid: "05beece933c14328a2f61dadcc270d87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } } }
I20260810 01:44:29.818367 6651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:29.819005 6652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "05beece933c14328a2f61dadcc270d87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beece933c14328a2f61dadcc270d87" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38409 } } }
I20260810 01:44:29.819175 6652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05beece933c14328a2f61dadcc270d87 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:29.819588 6656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:44:29.824514 6656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:44:29.825258 6656 catalog_manager.cc:1259] Loaded cluster ID: ea33e1eca17746b6bbd8f0dcccd335c5
I20260810 01:44:29.825315 6656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 01:44:29.826324 6656 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb12e74f9ad google::LogMessage::Fail() at ??:0
@ 0x7fb12e75288a google::LogMessage::SendToLog() at ??:0
@ 0x7fb12e74f4de google::LogMessage::Flush() at ??:0
@ 0x7fb12e750a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb139092fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fb139093d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb139090579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fb1390d4640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fb1309a13d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb1309a1c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fb1309a33f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fb130992512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb131fd66db start_thread at ??:0
@ 0x7fb12d24d61f clone at ??:0
W20260810 01:44:29.904208 6649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:29.904508 6649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:29.904579 6649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:29.910301 6649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:29.910357 6649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:29.910439 6649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:44:29.917593 6649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:42003
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=45775
--tserver_master_addrs=127.16.58.126:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:29.918907 6649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:29.920233 6649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:29.931349 6713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:29.931340 6709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:29.931696 6710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:29.931967 6649 server_base.cc:1034] running on GCE node
I20260810 01:44:29.932412 6649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:29.933198 6649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:29.934376 6649 hybrid_clock.cc:648] HybridClock initialized: now 1786326269934344 us; error 48 us; skew 500 ppm
Aug 10 01:44:29 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326269, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:29.937389 6649 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:44:29.938442 6649 webserver.cc:460] Webserver started at http://127.16.58.65:45775/ using document root <none> and password file <none>
I20260810 01:44:29.939145 6649 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:29.939236 6649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:29.945169 6649 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 01:44:29.947638 6720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:29.949266 6649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:44:29.949415 6649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "90a80720f88ece3f0dc109e6c64d817c"
server_key_iv: "c8b3209419dce6bdb220a536429c3af2"
server_key_version: "encryptionkey@0"
I20260810 01:44:29.950138 6649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:29.971307 6649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:29.976075 6649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:29.976305 6649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:29.977077 6649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:29.978473 6732 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 01:44:29.983868 6649 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 01:44:29.983980 6649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260810 01:44:29.984082 6649 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 01:44:29.986282 6649 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 01:44:29.986372 6649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.002s
I20260810 01:44:29.986681 6732 tablet_bootstrap.cc:492] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Bootstrap starting.
I20260810 01:44:29.996682 6649 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:42003
I20260810 01:44:29.996701 6897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:42003 every 8 connection(s)
I20260810 01:44:29.997674 6649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:44:30.005765 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 6649
I20260810 01:44:30.006237 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:34837
--local_ip_for_outbound_sockets=127.16.58.66
--tserver_master_addrs=127.16.58.126:38409
--webserver_port=42959
--webserver_interface=127.16.58.66
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:44:30.008605 6732 log.cc:824] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:30.017776 6732 tablet_bootstrap.cc:492] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:44:30.018165 6732 tablet_bootstrap.cc:492] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Bootstrap complete.
I20260810 01:44:30.019522 6732 ts_tablet_manager.cc:1397] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Time spent bootstrapping tablet: real 0.033s user 0.027s sys 0.004s
I20260810 01:44:30.022838 6732 raft_consensus.cc:348] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:30.023404 6732 raft_consensus.cc:729] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2f3b6a47b4f4cc081351e4bfc6066a2, State: Initialized, Role: FOLLOWER
I20260810 01:44:30.023988 6732 consensus_queue.cc:260] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:30.025063 6732 ts_tablet_manager.cc:1428] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
W20260810 01:44:30.045524 6901 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:44:29.999524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:38559)
0810 01:44:30.000024 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:30.000075 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:30.000896 (+ 821us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:30.044622 (+ 43726us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":134,"threads_started":1}
W20260810 01:44:30.046038 6899 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:38409 (0 consecutive failures): Network error: Failed to ping master at 127.16.58.126:38409: Client connection negotiation failed: client connection to 127.16.58.126:38409: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:44:30.046787 6901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:30.046512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:52709)
0810 01:44:30.046649 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:30.046721 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 01:44:30.047369 6901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:30.047163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:34253)
0810 01:44:30.047263 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:30.047313 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 01:44:30.047559 6899 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:44:30.122197 6904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:30.122432 6904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:30.122473 6904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:30.126379 6904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:30.126430 6904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:30.126494 6904 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:44:30.131578 6904 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:34837
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=42959
--tserver_master_addrs=127.16.58.126:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:30.132491 6904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:30.133385 6904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:30.142676 6914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:30.142714 6912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:30.142695 6916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:30.142832 6904 server_base.cc:1034] running on GCE node
I20260810 01:44:30.143298 6904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:30.143903 6904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:30.145057 6904 hybrid_clock.cc:648] HybridClock initialized: now 1786326270145031 us; error 34 us; skew 500 ppm
Aug 10 01:44:30 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326270, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:30.147559 6904 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:44:30.148382 6904 webserver.cc:460] Webserver started at http://127.16.58.66:42959/ using document root <none> and password file <none>
I20260810 01:44:30.148881 6904 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:30.148943 6904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:30.152395 6904 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:44:30.154227 6927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:30.155295 6904 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:30.155393 6904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "0c2cbdae9eed48f6bdf6e3e76967e425"
format_stamp: "Formatted at 2026-08-10 01:44:27 on dist-test-slave-jlzn"
server_key: "46120f27782a0c43655ff25573bf525b"
server_key_iv: "ec11ec70d5979c2f8a7a47a706a46d91"
server_key_version: "encryptionkey@0"
I20260810 01:44:30.155923 6904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:30.202775 6904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:30.205511 6904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:30.205691 6904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:30.206287 6904 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:30.207118 6904 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:30.207168 6904 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:30.207213 6904 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:30.207242 6904 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:30.215764 6904 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:34837
I20260810 01:44:30.215826 7104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:34837 every 8 connection(s)
I20260810 01:44:30.216710 6904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:44:30.220415 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:30.218602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:40725)
0810 01:44:30.219051 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:30.219168 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":120,"threads_started":1}
W20260810 01:44:30.220871 7105 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:38409 (0 consecutive failures): Network error: Failed to ping master at 127.16.58.126:38409: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
I20260810 01:44:30.221380 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:30.221175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:52301)
0810 01:44:30.221273 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:30.221326 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 01:44:30.221904 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:30.221742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:40937)
0810 01:44:30.221822 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:30.221860 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 01:44:30.222052 7105 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 01:44:30.226341 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 6904
I20260810 01:44:30.226697 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:42137
--local_ip_for_outbound_sockets=127.16.58.67
--tserver_master_addrs=127.16.58.126:38409
--webserver_port=37941
--webserver_interface=127.16.58.67
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:30.333636 7109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:30.333853 7109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:30.333891 7109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:30.337658 7109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:30.337702 7109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:30.337754 7109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:44:30.342573 7109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:42137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=37941
--tserver_master_addrs=127.16.58.126:38409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:30.343379 7109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:30.344235 7109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:30.353225 7116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:30.353256 7119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:30.353343 7109 server_base.cc:1034] running on GCE node
W20260810 01:44:30.353256 7117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:30.353796 7109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:30.354386 7109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:30.355545 7109 hybrid_clock.cc:648] HybridClock initialized: now 1786326270355516 us; error 41 us; skew 500 ppm
Aug 10 01:44:30 dist-test-slave-jlzn krb5kdc[4914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326270, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:30.358064 7109 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:44:30.358839 7109 webserver.cc:460] Webserver started at http://127.16.58.67:37941/ using document root <none> and password file <none>
I20260810 01:44:30.359373 7109 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:30.359444 7109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:30.362900 7109 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:30.364717 7134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:30.365759 7109 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:30.365872 7109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "1330bf3868bc421f862b7c34a1eb97dc"
format_stamp: "Formatted at 2026-08-10 01:44:28 on dist-test-slave-jlzn"
server_key: "34293bc3e7e86ca20fd2ac1b95c92b63"
server_key_iv: "4b5827ffa5cf5e444154525963e028e4"
server_key_version: "encryptionkey@0"
I20260810 01:44:30.366345 7109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:30.380818 7109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:30.383525 7109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:30.383683 7109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:30.384233 7109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:30.384969 7109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:30.385016 7109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:30.385066 7109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:30.385090 7109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:30.393010 7109 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:42137
I20260810 01:44:30.393067 7308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:42137 every 8 connection(s)
I20260810 01:44:30.393893 7109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:44:30.397313 7312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:30.395733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:44439)
0810 01:44:30.396168 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:30.396270 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":104,"threads_started":1}
W20260810 01:44:30.397707 7310 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:38409 (0 consecutive failures): Network error: Failed to ping master at 127.16.58.126:38409: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
I20260810 01:44:30.398231 7312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:30.398043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:58659)
0810 01:44:30.398133 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:30.398178 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 01:44:30.398743 7312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:30.398562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:56713)
0810 01:44:30.398655 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:30.398694 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 01:44:30.398896 7310 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 01:44:30.403105 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 7109
I20260810 01:44:31.048491 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:31.048101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:52915)
0810 01:44:31.048325 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:31.048377 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":75,"threads_started":1}
I20260810 01:44:31.222862 7318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:31.222504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:55963)
0810 01:44:31.222714 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:31.222763 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":66,"threads_started":1}
I20260810 01:44:31.399796 7319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:31.399388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:45641)
0810 01:44:31.399624 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:31.399681 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":67,"threads_started":1}
I20260810 01:44:31.425299 7320 raft_consensus.cc:482] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:44:31.425529 7320 raft_consensus.cc:504] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:31.426599 7320 leader_election.cc:288] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137), 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837)
Aug 10 01:44:31 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326269, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.67@KRBTEST.COM
Aug 10 01:44:31 dist-test-slave-jlzn krb5kdc[4914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326269, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.66@KRBTEST.COM
I20260810 01:44:31.439859 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:31.426816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:42137 (local address 127.16.58.65:39893)
0810 01:44:31.426925 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:31.426939 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:31.427059 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:31.428903 (+ 1844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:31.428909 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:31.429421 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:31.429917 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:31.429931 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:31.431186 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:31.431189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:31.432259 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:31.432269 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:31.432927 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:31.432931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:31.433160 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:31.433739 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:31.433762 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:31.435318 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:31.437473 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:31.437479 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:31.437492 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:31.437855 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:31.438183 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:31.438186 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:31.438188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:31.438341 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:31.438914 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:31.438920 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:31.439144 (+ 224us) client_negotiation.cc:769] Sending connection context
0810 01:44:31.439303 (+ 159us) client_negotiation.cc:240] Negotiation successful
0810 01:44:31.439631 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":168,"spinlock_wait_cycles":27392}
I20260810 01:44:31.439893 7322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:31.427052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:33429 (local address 127.16.58.66:34837)
0810 01:44:31.427394 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:31.427415 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:31.427452 (+ 37us) server_negotiation.cc:407] Connection header received
0810 01:44:31.428199 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:31.428206 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:31.428546 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:31.428785 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:31.430092 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:31.431101 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:31.432374 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:31.432825 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:31.432970 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:31.435882 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:31.435886 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:31.435896 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:31.435926 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:31.437377 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:31.437964 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:31.437968 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:31.437972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:31.438088 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:31.438429 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:31.438432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:31.438434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:31.438799 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:31.438917 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:31.439437 (+ 520us) server_negotiation.cc:299] Negotiation successful
0810 01:44:31.439714 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":109,"threads_started":1}
I20260810 01:44:31.439921 7323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:31.427320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:39893 (local address 127.16.58.67:42137)
0810 01:44:31.427641 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:31.427660 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:31.427692 (+ 32us) server_negotiation.cc:407] Connection header received
0810 01:44:31.428348 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:31.428354 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:31.428649 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:31.428925 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:31.430090 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:31.431050 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:31.432369 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:31.432813 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:31.432962 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:31.435583 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:31.435591 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:31.435606 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:31.435640 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:31.437352 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:31.437965 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:31.437971 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:31.437975 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:31.438091 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:31.438435 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:31.438438 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:31.438439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:31.438799 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:31.438917 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:31.439440 (+ 523us) server_negotiation.cc:299] Negotiation successful
0810 01:44:31.439704 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":85,"threads_started":1}
I20260810 01:44:31.439910 7321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:31.426863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34837 (local address 127.16.58.65:33429)
0810 01:44:31.427136 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:31.427148 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:31.427246 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:31.428905 (+ 1659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:31.428910 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:31.429421 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:31.429917 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:31.429931 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:31.431264 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:31.431275 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:31.432261 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:31.432272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:31.432940 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:31.432944 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:31.433162 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:31.433775 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:31.433787 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:31.435679 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:31.437489 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:31.437492 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:31.437493 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:31.437859 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:31.438182 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:31.438185 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:31.438187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:31.438340 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:31.438916 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:31.438922 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:31.439144 (+ 222us) client_negotiation.cc:769] Sending connection context
0810 01:44:31.439302 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 01:44:31.439704 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":292,"spinlock_wait_cycles":91648,"thread_start_us":110,"threads_started":1}
W20260810 01:44:31.442659 6726 leader_election.cc:341] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137): Not found: Tablet not found: b257f06d6583447399e869f33a7cd259
W20260810 01:44:31.442812 6721 leader_election.cc:341] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837): Not found: Tablet not found: b257f06d6583447399e869f33a7cd259
I20260810 01:44:31.442881 6721 leader_election.cc:302] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2f3b6a47b4f4cc081351e4bfc6066a2; no voters: 0c2cbdae9eed48f6bdf6e3e76967e425, 1330bf3868bc421f862b7c34a1eb97dc
I20260810 01:44:31.443143 7320 raft_consensus.cc:2726] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:44:32.049587 7325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:32.049168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:42837)
0810 01:44:32.049425 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:32.049482 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":76,"threads_started":1}
I20260810 01:44:32.223889 7329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:32.223466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:34471)
0810 01:44:32.223704 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:32.223759 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":69,"threads_started":1}
I20260810 01:44:32.400811 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:32.400425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:51631)
0810 01:44:32.400675 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:32.400727 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":94,"threads_started":1}
I20260810 01:44:32.969316 7331 raft_consensus.cc:482] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:44:32.969451 7331 raft_consensus.cc:504] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:32.969852 7331 leader_election.cc:288] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137), 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837)
W20260810 01:44:32.970630 6721 leader_election.cc:341] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837): Not found: Tablet not found: b257f06d6583447399e869f33a7cd259
W20260810 01:44:32.970736 6726 leader_election.cc:341] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137): Not found: Tablet not found: b257f06d6583447399e869f33a7cd259
I20260810 01:44:32.970842 6726 leader_election.cc:302] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2f3b6a47b4f4cc081351e4bfc6066a2; no voters: 0c2cbdae9eed48f6bdf6e3e76967e425, 1330bf3868bc421f862b7c34a1eb97dc
I20260810 01:44:32.970988 7331 raft_consensus.cc:2726] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:44:33.050663 7332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:33.050272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:44399)
0810 01:44:33.050506 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:33.050559 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":75,"threads_started":1}
I20260810 01:44:33.224867 7334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:33.224506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:52929)
0810 01:44:33.224734 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:33.224783 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":72,"threads_started":1}
I20260810 01:44:33.401849 7335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:33.401428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:47443)
0810 01:44:33.401706 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:33.401760 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":89,"threads_started":1}
I20260810 01:44:34.051920 7336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:34.051394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:32899)
0810 01:44:34.051692 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:34.051772 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":92,"threads_started":1}
I20260810 01:44:34.225884 7337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:34.225515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:55695)
0810 01:44:34.225742 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:34.225794 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":72,"threads_started":1}
I20260810 01:44:34.402897 7338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:34.402500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:34271)
0810 01:44:34.402749 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:34.402801 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":76,"threads_started":1}
I20260810 01:44:35.053246 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:35.052794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:48371)
0810 01:44:35.053093 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:35.053146 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":83,"threads_started":1}
I20260810 01:44:35.226918 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:35.226555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:38961)
0810 01:44:35.226776 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:35.226827 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":75,"threads_started":1}
I20260810 01:44:35.403893 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:35.403520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:44691)
0810 01:44:35.403737 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:35.403786 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":75,"threads_started":1}
I20260810 01:44:36.054404 7345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:36.053902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:38867)
0810 01:44:36.054218 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:36.054275 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":92,"threads_started":1}
I20260810 01:44:36.104210 7346 raft_consensus.cc:482] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:44:36.104339 7346 raft_consensus.cc:504] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:36.104709 7346 leader_election.cc:288] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137), 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837)
W20260810 01:44:36.105448 6726 leader_election.cc:341] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137): Not found: Tablet not found: b257f06d6583447399e869f33a7cd259
W20260810 01:44:36.105562 6721 leader_election.cc:341] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837): Not found: Tablet not found: b257f06d6583447399e869f33a7cd259
I20260810 01:44:36.105626 6721 leader_election.cc:302] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2f3b6a47b4f4cc081351e4bfc6066a2; no voters: 0c2cbdae9eed48f6bdf6e3e76967e425, 1330bf3868bc421f862b7c34a1eb97dc
I20260810 01:44:36.105762 7346 raft_consensus.cc:2726] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:44:36.228012 7347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:36.227603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:36739)
0810 01:44:36.227868 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:36.227919 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":73,"threads_started":1}
I20260810 01:44:36.404960 7349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:36.404540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:35453)
0810 01:44:36.404819 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:36.404870 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":95,"threads_started":1}
I20260810 01:44:37.055500 7350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:37.055108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:58045)
0810 01:44:37.055352 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:37.055402 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":81,"threads_started":1}
I20260810 01:44:37.229028 7352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:37.228632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:54261)
0810 01:44:37.228893 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:37.228942 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":72,"threads_started":1}
I20260810 01:44:37.406018 7353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:37.405559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:33439)
0810 01:44:37.405869 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:37.405927 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":70,"threads_started":1}
I20260810 01:44:38.056555 7357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:38.056165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:49789)
0810 01:44:38.056397 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:38.056450 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":84,"threads_started":1}
I20260810 01:44:38.230042 7358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:38.229641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:58389)
0810 01:44:38.229892 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:38.229949 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":72,"threads_started":1}
I20260810 01:44:38.407001 7359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:38.406647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:41733)
0810 01:44:38.406863 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:38.406913 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":73,"threads_started":1}
I20260810 01:44:39.057560 7362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:39.057178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:60843)
0810 01:44:39.057410 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:39.057461 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":70,"threads_started":1}
I20260810 01:44:39.231030 7364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:39.230672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:42569)
0810 01:44:39.230889 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:39.230941 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":72,"threads_started":1}
I20260810 01:44:39.408032 7367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:39.407616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:36353)
0810 01:44:39.407894 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:39.407944 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":97,"threads_started":1}
I20260810 01:44:40.058705 7369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:40.058323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:48487)
0810 01:44:40.058544 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:40.058595 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":68,"threads_started":1}
I20260810 01:44:40.232097 7371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:40.231692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:36169)
0810 01:44:40.231946 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:40.232001 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":70,"threads_started":1}
I20260810 01:44:40.409021 7372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:40.408660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:59865)
0810 01:44:40.408885 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:40.408937 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":67,"threads_started":1}
I20260810 01:44:40.610442 7373 raft_consensus.cc:482] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:44:40.610574 7373 raft_consensus.cc:504] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1330bf3868bc421f862b7c34a1eb97dc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 42137 } } peers { permanent_uuid: "0c2cbdae9eed48f6bdf6e3e76967e425" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34837 } } peers { permanent_uuid: "d2f3b6a47b4f4cc081351e4bfc6066a2" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42003 } }
I20260810 01:44:40.610926 7373 leader_election.cc:288] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137), 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837)
W20260810 01:44:40.611663 6726 leader_election.cc:341] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1330bf3868bc421f862b7c34a1eb97dc (127.16.58.67:42137): Not found: Tablet not found: b257f06d6583447399e869f33a7cd259
W20260810 01:44:40.611771 6721 leader_election.cc:341] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0c2cbdae9eed48f6bdf6e3e76967e425 (127.16.58.66:34837): Not found: Tablet not found: b257f06d6583447399e869f33a7cd259
I20260810 01:44:40.611896 6721 leader_election.cc:302] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2f3b6a47b4f4cc081351e4bfc6066a2; no voters: 0c2cbdae9eed48f6bdf6e3e76967e425, 1330bf3868bc421f862b7c34a1eb97dc
I20260810 01:44:40.612052 7373 raft_consensus.cc:2726] T b257f06d6583447399e869f33a7cd259 P d2f3b6a47b4f4cc081351e4bfc6066a2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:44:41.059830 7376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:41.059384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:40325)
0810 01:44:41.059651 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:41.059705 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":109,"threads_started":1}
I20260810 01:44:41.233182 7379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:41.232789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:39915)
0810 01:44:41.233038 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:41.233092 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":81,"threads_started":1}
I20260810 01:44:41.410102 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:41.409683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:53741)
0810 01:44:41.409944 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:41.410003 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":76,"threads_started":1}
I20260810 01:44:42.060865 7382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:42.060490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:33853)
0810 01:44:42.060715 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:42.060764 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":74,"threads_started":1}
I20260810 01:44:42.234190 7383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:42.233814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:53253)
0810 01:44:42.234033 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:42.234083 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":71,"threads_started":1}
I20260810 01:44:42.411233 7384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:42.410820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:37685)
0810 01:44:42.411063 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:42.411118 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":76,"threads_started":1}
I20260810 01:44:43.061980 7385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:43.061574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:43735)
0810 01:44:43.061825 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:43.061877 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":83,"threads_started":1}
I20260810 01:44:43.235234 7386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:43.234829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:57011)
0810 01:44:43.235075 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:43.235129 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":71,"threads_started":1}
I20260810 01:44:43.412263 7387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:43.411900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:55915)
0810 01:44:43.412121 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:43.412174 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":70,"threads_started":1}
I20260810 01:44:44.063040 7388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:44.062607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:50803)
0810 01:44:44.062885 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:44.062937 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":101,"threads_started":1}
I20260810 01:44:44.236341 7389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:44.235932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:51931)
0810 01:44:44.236186 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:44.236243 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":76,"threads_started":1}
I20260810 01:44:44.413288 7391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:44.412879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:37161)
0810 01:44:44.413140 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:44.413191 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":78,"threads_started":1}
I20260810 01:44:45.064308 7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:45.063916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.65:34309)
0810 01:44:45.064160 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:45.064211 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":89,"threads_started":1}
I20260810 01:44:45.237488 7395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:45.237084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.66:36141)
0810 01:44:45.237334 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:45.237390 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":84,"threads_started":1}
I20260810 01:44:45.411648 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 6649
I20260810 01:44:45.418596 7396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:45.418227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38409 (local address 127.16.58.67:48873)
0810 01:44:45.418447 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:45.418499 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:38409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":63,"threads_started":1}
I20260810 01:44:45.424242 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 6904
I20260810 01:44:45.433902 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 7109
2026-08-10T01:44:45Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19440 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:44:45 dist-test-slave-jlzn krb5kdc[7400](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:44:45 dist-test-slave-jlzn krb5kdc[7400](info): set up 2 sockets
Aug 10 01:44:45 dist-test-slave-jlzn krb5kdc[7400](info): commencing operation
krb5kdc: starting...
W20260810 01:44:46.569243 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:44:46 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:44:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:44:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:44:46.683673 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35721
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:35721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:46.790650 7419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:46.790906 7419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:46.790946 7419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:46.794862 7419 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 01:44:46.794906 7419 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 01:44:46.794920 7419 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 01:44:46.794934 7419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:44:46.794963 7419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:46.794994 7419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:46.795020 7419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:44:46.795042 7419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:44:46.800134 7419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:35721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:46.801050 7419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:46.801997 7419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:46.810169 7424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:46.810173 7427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:46.810295 7419 server_base.cc:1034] running on GCE node
W20260810 01:44:46.810168 7425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:46.810962 7419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:46.812028 7419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:46.813189 7419 hybrid_clock.cc:648] HybridClock initialized: now 1786326286813173 us; error 27 us; skew 500 ppm
Aug 10 01:44:46 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326286, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:46.815867 7419 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:44:46.816721 7419 webserver.cc:460] Webserver started at http://127.16.58.126:33121/ using document root <none> and password file <none>
I20260810 01:44:46.817226 7419 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:46.817284 7419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:46.817478 7419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:46.819429 7419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "8152a7df51ed47ee80057a28123cefd5"
format_stamp: "Formatted at 2026-08-10 01:44:46 on dist-test-slave-jlzn"
server_key: "a8e3f22f30eafbcbe49280fe0a92d0bc"
server_key_iv: "1525cb64fdb83f340da482591550757b"
server_key_version: "encryptionkey@0"
I20260810 01:44:46.819998 7419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "8152a7df51ed47ee80057a28123cefd5"
format_stamp: "Formatted at 2026-08-10 01:44:46 on dist-test-slave-jlzn"
server_key: "a8e3f22f30eafbcbe49280fe0a92d0bc"
server_key_iv: "1525cb64fdb83f340da482591550757b"
server_key_version: "encryptionkey@0"
I20260810 01:44:46.823413 7419 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:44:46.825663 7438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:46.826785 7419 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:46.826887 7419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "8152a7df51ed47ee80057a28123cefd5"
format_stamp: "Formatted at 2026-08-10 01:44:46 on dist-test-slave-jlzn"
server_key: "a8e3f22f30eafbcbe49280fe0a92d0bc"
server_key_iv: "1525cb64fdb83f340da482591550757b"
server_key_version: "encryptionkey@0"
I20260810 01:44:46.826982 7419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:46.838683 7419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:46.841285 7419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:46.841454 7419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:46.848075 7419 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:35721
I20260810 01:44:46.848353 7508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:35721 every 8 connection(s)
I20260810 01:44:46.848977 7419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:44:46.851634 7509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:46.856873 7509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Bootstrap starting.
I20260810 01:44:46.858819 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 7419
I20260810 01:44:46.858933 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:44:46.859237 16617 external_mini_cluster.cc:1428] Setting key 82c9d8051ac0d1e1ceb8aad420b8fa96
I20260810 01:44:46.859411 7509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:46.860249 7509 log.cc:824] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:46.862098 7509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: No bootstrap required, opened a new log
I20260810 01:44:46.866398 7509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:44:46.866669 7509 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:46.867074 7509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8152a7df51ed47ee80057a28123cefd5, State: Initialized, Role: FOLLOWER
I20260810 01:44:46.867568 7509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:44:46.867758 7509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:44:46.867875 7509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:44:46.868007 7509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 0 FOLLOWER]: Advancing to term 1
Aug 10 01:44:46 dist-test-slave-jlzn krb5kdc[7400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:46.869132 7509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:44:46.869493 7509 leader_election.cc:302] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8152a7df51ed47ee80057a28123cefd5; no voters:
I20260810 01:44:46.869809 7509 leader_election.cc:288] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:44:46.870136 7523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:44:46.870482 7523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 1 LEADER]: Becoming Leader. State: Replica: 8152a7df51ed47ee80057a28123cefd5, State: Running, Role: LEADER
I20260810 01:44:46.870843 7523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:44:46.871181 7509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:44:46.872567 7526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8152a7df51ed47ee80057a28123cefd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } } }
I20260810 01:44:46.872709 7526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: This master's current role is: LEADER
I20260810 01:44:46.872953 7526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8152a7df51ed47ee80057a28123cefd5. Latest consensus state: current_term: 1 leader_uuid: "8152a7df51ed47ee80057a28123cefd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } } }
I20260810 01:44:46.873031 7526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: This master's current role is: LEADER
W20260810 01:44:46.876085 7549 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 01:44:46.876086 7518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:46.860334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44416 (local address 127.16.58.126:35721)
0810 01:44:46.860855 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:46.860875 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:46.860917 (+ 42us) server_negotiation.cc:407] Connection header received
0810 01:44:46.861615 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:46.861641 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:46.861935 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:46.862220 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:46.863008 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:46.864380 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:46.865540 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:46.866219 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:46.866373 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:46.869369 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:46.869375 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:46.869392 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:46.869424 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:46.872019 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:46.872791 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:46.872801 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:46.872807 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:46.872953 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:46.873308 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:46.873311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:46.873313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:46.873804 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:46.874672 (+ 868us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:46.874822 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 01:44:46.875076 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":134,"threads_started":1}
W20260810 01:44:46.876210 7549 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:44:46.876463 7544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:44:46.877159 7544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:44:46.881737 7544 catalog_manager.cc:1347] Generated new cluster ID: ad4d235a58914559b70535647fa83b71
I20260810 01:44:46.881798 7544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:44:46.903952 7544 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:44:46.904862 7544 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:44:46.912364 7544 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Generated new TSK 0
I20260810 01:44:46.913017 7544 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:44:46.942656 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35721
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:47.051522 7560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:47.051759 7560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:47.051823 7560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:47.055672 7560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:47.055725 7560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:47.055792 7560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:44:47.060781 7560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:47.061712 7560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:47.062672 7560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:47.071771 7573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:47.071782 7569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:47.071870 7560 server_base.cc:1034] running on GCE node
W20260810 01:44:47.071841 7568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:47.072430 7560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:47.073041 7560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:47.074199 7560 hybrid_clock.cc:648] HybridClock initialized: now 1786326287074184 us; error 29 us; skew 500 ppm
Aug 10 01:44:47 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326287, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:47.076774 7560 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:44:47.077546 7560 webserver.cc:460] Webserver started at http://127.16.58.65:32815/ using document root <none> and password file <none>
I20260810 01:44:47.078073 7560 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:47.078137 7560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:47.078317 7560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:47.080263 7560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "bcafe671eccb47b082fd8f87572e5a1d"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "ff6f70b38368c8959c407db107d7296a"
server_key_iv: "29f5837a7d34f1f7bf722952d8059ee2"
server_key_version: "encryptionkey@0"
I20260810 01:44:47.080794 7560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "bcafe671eccb47b082fd8f87572e5a1d"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "ff6f70b38368c8959c407db107d7296a"
server_key_iv: "29f5837a7d34f1f7bf722952d8059ee2"
server_key_version: "encryptionkey@0"
I20260810 01:44:47.084193 7560 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:44:47.086329 7582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:47.087412 7560 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:44:47.087528 7560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "bcafe671eccb47b082fd8f87572e5a1d"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "ff6f70b38368c8959c407db107d7296a"
server_key_iv: "29f5837a7d34f1f7bf722952d8059ee2"
server_key_version: "encryptionkey@0"
I20260810 01:44:47.087623 7560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:47.113256 7560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:47.115883 7560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:47.116047 7560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:47.116593 7560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:47.117384 7560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:47.117431 7560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:47.117482 7560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:47.117511 7560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:47.125733 7560 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:43333
I20260810 01:44:47.125758 7745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:43333 every 8 connection(s)
I20260810 01:44:47.126529 7560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:44:47.128575 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 7560
I20260810 01:44:47.128710 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:44:47.129045 16617 external_mini_cluster.cc:1428] Setting key d5455a99a942e2bfb66a579b2dfd0340
Aug 10 01:44:47 dist-test-slave-jlzn krb5kdc[7400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326287, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:44:47.140336 7518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.128187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:35883 (local address 127.16.58.126:35721)
0810 01:44:47.128308 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:47.128312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:47.129172 (+ 860us) server_negotiation.cc:407] Connection header received
0810 01:44:47.130790 (+ 1618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:47.130792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:47.130835 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:47.130892 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:47.132356 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.132885 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.134351 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.134561 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.134650 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.137076 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:47.137079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:47.137081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:47.137104 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:47.138405 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:47.138867 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:47.138870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:47.138871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:47.138950 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:47.139265 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:47.139268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:47.139270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:47.139443 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:47.139529 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:47.140041 (+ 512us) server_negotiation.cc:299] Negotiation successful
0810 01:44:47.140170 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:44:47.141038 7750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.128508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:35883)
0810 01:44:47.129008 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:47.129062 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:47.130581 (+ 1519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:47.131068 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:47.131076 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:47.131549 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:47.132189 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.132207 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.133008 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.133012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.134254 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.134265 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.134708 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.134712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.134864 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.135371 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:47.135387 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:47.136925 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:47.138510 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:47.138516 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:47.138529 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:47.138774 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:47.139031 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:47.139034 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:47.139036 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:47.139177 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:47.139545 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:47.139551 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:47.139779 (+ 228us) client_negotiation.cc:769] Sending connection context
0810 01:44:47.139981 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 01:44:47.140287 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":136,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
I20260810 01:44:47.142145 7746 heartbeater.cc:347] Connected to a master server at 127.16.58.126:35721
I20260810 01:44:47.142377 7746 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:47.142921 7746 heartbeater.cc:511] Master 127.16.58.126:35721 requested a full tablet report, sending...
I20260810 01:44:47.144647 7462 ts_manager.cc:194] Registered new tserver with Master: bcafe671eccb47b082fd8f87572e5a1d (127.16.58.65:43333)
I20260810 01:44:47.145784 7462 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:35883
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:44:47.155978 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35721
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:47.264771 7754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:47.265002 7754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:47.265041 7754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:47.269017 7754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:47.269069 7754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:47.269122 7754 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:44:47.274188 7754 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:47.275033 7754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:47.275951 7754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:47.284942 7760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:47.284955 7765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:47.284974 7761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:47.285148 7754 server_base.cc:1034] running on GCE node
I20260810 01:44:47.285578 7754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:47.286154 7754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:47.287323 7754 hybrid_clock.cc:648] HybridClock initialized: now 1786326287287309 us; error 29 us; skew 500 ppm
Aug 10 01:44:47 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326287, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:47.289942 7754 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:44:47.290783 7754 webserver.cc:460] Webserver started at http://127.16.58.66:34473/ using document root <none> and password file <none>
I20260810 01:44:47.291358 7754 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:47.291427 7754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:47.291635 7754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:47.293668 7754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "0647b925294f0f078fce009da2ff013b"
server_key_iv: "7c9e3054478aedc88e319e45c0815490"
server_key_version: "encryptionkey@0"
I20260810 01:44:47.294224 7754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "0647b925294f0f078fce009da2ff013b"
server_key_iv: "7c9e3054478aedc88e319e45c0815490"
server_key_version: "encryptionkey@0"
I20260810 01:44:47.297753 7754 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:44:47.300104 7780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:47.301218 7754 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:44:47.301333 7754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "0647b925294f0f078fce009da2ff013b"
server_key_iv: "7c9e3054478aedc88e319e45c0815490"
server_key_version: "encryptionkey@0"
I20260810 01:44:47.301425 7754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:47.317808 7754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:47.320695 7754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:47.320856 7754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:47.321382 7754 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:47.322458 7754 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:47.322518 7754 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:47.322571 7754 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:47.322602 7754 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:47.330871 7754 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:42815
I20260810 01:44:47.330927 7957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:42815 every 8 connection(s)
I20260810 01:44:47.331751 7754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
Aug 10 01:44:47 dist-test-slave-jlzn krb5kdc[7400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326287, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:47.341917 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 7754
I20260810 01:44:47.342041 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:44:47.342370 16617 external_mini_cluster.cc:1428] Setting key 2c6d930f0365252da5e42ab788d52b11
I20260810 01:44:47.344194 7518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.333373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:44469 (local address 127.16.58.126:35721)
0810 01:44:47.333505 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:47.333510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:47.334333 (+ 823us) server_negotiation.cc:407] Connection header received
0810 01:44:47.335544 (+ 1211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:47.335547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:47.335594 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:47.335670 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:47.336732 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.337255 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.338301 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.338511 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.338574 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.340715 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:47.340718 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:47.340720 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:47.340746 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:47.342135 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:47.342600 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:47.342603 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:47.342605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:47.342707 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:47.343073 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:47.343076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:47.343077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:47.343261 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:47.343353 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:47.343916 (+ 563us) server_negotiation.cc:299] Negotiation successful
0810 01:44:47.344036 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:44:47.344870 7961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.333758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:44469)
0810 01:44:47.334196 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:47.334237 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:47.335371 (+ 1134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:47.335824 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:47.335833 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:47.336179 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:47.336614 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.336627 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.337351 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.337354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.338209 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.338218 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.338605 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.338607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.338740 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.339191 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:47.339205 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:47.340563 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:47.342233 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:47.342238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:47.342248 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:47.342512 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:47.342808 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:47.342811 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:47.342813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:47.342992 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:47.343367 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:47.343373 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:47.343646 (+ 273us) client_negotiation.cc:769] Sending connection context
0810 01:44:47.343854 (+ 208us) client_negotiation.cc:240] Negotiation successful
0810 01:44:47.344099 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":116,"threads_started":1}
I20260810 01:44:47.345888 7958 heartbeater.cc:347] Connected to a master server at 127.16.58.126:35721
I20260810 01:44:47.346096 7958 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:47.346526 7958 heartbeater.cc:511] Master 127.16.58.126:35721 requested a full tablet report, sending...
I20260810 01:44:47.347440 7462 ts_manager.cc:194] Registered new tserver with Master: 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815)
I20260810 01:44:47.348008 7462 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:44469
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:44:47.367508 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35721
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:44:47.474078 7968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:44:47.474300 7968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:44:47.474342 7968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:44:47.478248 7968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:44:47.478297 7968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:44:47.478365 7968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:44:47.483332 7968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:35721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:44:47.484270 7968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:44:47.485184 7968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:44:47.494163 7978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:47.494164 7982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:44:47.494192 7976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:44:47.494479 7968 server_base.cc:1034] running on GCE node
I20260810 01:44:47.494853 7968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:44:47.495407 7968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:44:47.496559 7968 hybrid_clock.cc:648] HybridClock initialized: now 1786326287496542 us; error 27 us; skew 500 ppm
Aug 10 01:44:47 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326287, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:44:47.499107 7968 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:44:47.499907 7968 webserver.cc:460] Webserver started at http://127.16.58.67:34723/ using document root <none> and password file <none>
I20260810 01:44:47.500404 7968 fs_manager.cc:359] Metadata directory not provided
I20260810 01:44:47.500463 7968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:44:47.500662 7968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:44:47.502532 7968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "794969939b6048419449a02ce3dbbe8b"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "2a91a512977c4e54b3db479d1b4e589a"
server_key_iv: "d8dedb9e647a6284e5857cf5aac8cdf5"
server_key_version: "encryptionkey@0"
I20260810 01:44:47.503051 7968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "794969939b6048419449a02ce3dbbe8b"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "2a91a512977c4e54b3db479d1b4e589a"
server_key_iv: "d8dedb9e647a6284e5857cf5aac8cdf5"
server_key_version: "encryptionkey@0"
I20260810 01:44:47.506596 7968 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260810 01:44:47.508852 7993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:47.509987 7968 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:44:47.510089 7968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "794969939b6048419449a02ce3dbbe8b"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "2a91a512977c4e54b3db479d1b4e589a"
server_key_iv: "d8dedb9e647a6284e5857cf5aac8cdf5"
server_key_version: "encryptionkey@0"
I20260810 01:44:47.510186 7968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:44:47.528870 7968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:44:47.531956 7968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:44:47.532116 7968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:44:47.532663 7968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:44:47.533447 7968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:44:47.533493 7968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:47.533535 7968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:44:47.533571 7968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:44:47.541821 7968 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:38501
I20260810 01:44:47.541841 8167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:38501 every 8 connection(s)
I20260810 01:44:47.542632 7968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
Aug 10 01:44:47 dist-test-slave-jlzn krb5kdc[7400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326287, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:44:47.552600 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 7968
I20260810 01:44:47.552711 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:44:47.552961 16617 external_mini_cluster.cc:1428] Setting key 00bb8f38bd56647e99f16db7316472b0
I20260810 01:44:47.555119 7518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.544324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:47497 (local address 127.16.58.126:35721)
0810 01:44:47.544464 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:47.544469 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:47.545298 (+ 829us) server_negotiation.cc:407] Connection header received
0810 01:44:47.546509 (+ 1211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:47.546512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:47.546565 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:47.546637 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:47.547647 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.548206 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.549243 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.549444 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.549507 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.551662 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:47.551665 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:47.551667 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:47.551693 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:47.553072 (+ 1379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:47.553579 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:47.553582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:47.553584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:47.553670 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:47.554009 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:47.554011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:47.554012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:47.554212 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:47.554308 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:47.554860 (+ 552us) server_negotiation.cc:299] Negotiation successful
0810 01:44:47.554988 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:44:47.555970 8178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.544740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:47497)
0810 01:44:47.545157 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:47.545197 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:47.546333 (+ 1136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:47.546779 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:47.546785 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:47.547101 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:44:47.547534 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.547546 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.548298 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.548301 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.549152 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.549161 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.549541 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.549543 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.549681 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.550146 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:44:47.550161 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:44:47.551500 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:44:47.553193 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:47.553199 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:47.553212 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:47.553472 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:47.553767 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:44:47.553769 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:44:47.553771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:44:47.553926 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:44:47.554310 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:44:47.554315 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:44:47.554609 (+ 294us) client_negotiation.cc:769] Sending connection context
0810 01:44:47.554826 (+ 217us) client_negotiation.cc:240] Negotiation successful
0810 01:44:47.555146 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":110,"threads_started":1}
I20260810 01:44:47.556962 8170 heartbeater.cc:347] Connected to a master server at 127.16.58.126:35721
I20260810 01:44:47.557160 8170 heartbeater.cc:464] Registering TS with master...
I20260810 01:44:47.557575 8170 heartbeater.cc:511] Master 127.16.58.126:35721 requested a full tablet report, sending...
I20260810 01:44:47.558470 7462 ts_manager.cc:194] Registered new tserver with Master: 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
I20260810 01:44:47.558997 7462 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:47497
I20260810 01:44:47.566529 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:44:47.575145 7518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.568431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44422 (local address 127.16.58.126:35721)
0810 01:44:47.568549 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:47.568553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:47.568722 (+ 169us) server_negotiation.cc:407] Connection header received
0810 01:44:47.568827 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:47.568830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:47.568871 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:47.568930 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:44:47.569563 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.570176 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.570978 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.571199 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.571281 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.572513 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:44:47.572517 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:44:47.572520 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:44:47.572543 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:44:47.573659 (+ 1116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:47.574021 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:47.574024 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:47.574026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:47.574102 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:44:47.574344 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:44:47.574348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:44:47.574349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:44:47.574549 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:44:47.574663 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:47.574898 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 01:44:47.574997 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:44:47.577831 7462 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:44:47.580722 7462 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:44:47.594556 8190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.588780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:38501 (local address 127.0.0.1:46168)
0810 01:44:47.589343 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:47.589391 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:47.589503 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:47.590528 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:47.590531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:47.590548 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:47.590694 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.590702 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.592045 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.592049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.593016 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.593026 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.594052 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.594056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.594162 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.594202 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 01:44:47.594298 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 01:44:47.594410 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"mutex_wait_us":58,"spinlock_wait_cycles":2816,"thread_start_us":100,"threads_started":1}
I20260810 01:44:47.594736 8192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.588907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46168 (local address 127.16.58.67:38501)
0810 01:44:47.589905 (+ 998us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:47.589917 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:47.589939 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:44:47.590006 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:47.590011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:47.590187 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:47.590326 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:47.590808 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.591914 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.593135 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.593918 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.594017 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.594151 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:47.594504 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 01:44:47.594596 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":904,"thread_start_us":83,"threads_started":1}
I20260810 01:44:47.594734 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.588617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:43333 (local address 127.0.0.1:52344)
0810 01:44:47.589679 (+ 1062us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:47.589691 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:47.589764 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:47.590262 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:47.590268 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:47.590289 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:47.590410 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.590417 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.591907 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.591910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.593357 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.593365 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.594296 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.594300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.594384 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.594410 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:44:47.594480 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:44:47.594547 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":117,"thread_start_us":64,"threads_started":1}
I20260810 01:44:47.594954 8194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.589479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42815 (local address 127.0.0.1:38358)
0810 01:44:47.589919 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:47.589931 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:47.589996 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:47.590543 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:47.590545 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:47.590558 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:47.590677 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.590684 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.591856 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.591859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.593428 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.593439 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.594596 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.594600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.594682 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.594702 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:44:47.594768 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 01:44:47.594831 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":316,"spinlock_wait_cycles":1280,"thread_start_us":89,"threads_started":1}
I20260810 01:44:47.595284 8195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.589643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38358 (local address 127.16.58.66:42815)
0810 01:44:47.590039 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:47.590049 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:47.590067 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:44:47.590129 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:47.590143 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:47.590297 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:47.590420 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:47.590883 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.591696 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.593562 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.594319 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.594408 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.594536 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:47.595043 (+ 507us) server_negotiation.cc:299] Negotiation successful
0810 01:44:47.595141 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":117,"threads_started":1}
I20260810 01:44:47.595573 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.588758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52344 (local address 127.16.58.65:43333)
0810 01:44:47.589809 (+ 1051us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:47.589825 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:47.589849 (+ 24us) server_negotiation.cc:407] Connection header received
0810 01:44:47.589925 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:47.589930 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:47.590129 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:47.590260 (+ 131us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:47.590513 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.591644 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.593470 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.594172 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.594281 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.594415 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:47.594813 (+ 398us) server_negotiation.cc:299] Negotiation successful
0810 01:44:47.594906 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":937,"thread_start_us":119,"threads_started":1}
I20260810 01:44:47.597664 8064 tablet_service.cc:1467] Processing CreateTablet for tablet a6637f0282b4486c99830a99081e216f (DEFAULT_TABLE table=test-table [id=90bcf4a45bd54468a67e2a8438a77fa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:47.597877 7861 tablet_service.cc:1467] Processing CreateTablet for tablet a6637f0282b4486c99830a99081e216f (DEFAULT_TABLE table=test-table [id=90bcf4a45bd54468a67e2a8438a77fa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:47.597990 7651 tablet_service.cc:1467] Processing CreateTablet for tablet a6637f0282b4486c99830a99081e216f (DEFAULT_TABLE table=test-table [id=90bcf4a45bd54468a67e2a8438a77fa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:44:47.598608 8064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6637f0282b4486c99830a99081e216f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:47.598874 7651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6637f0282b4486c99830a99081e216f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:47.598874 7861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6637f0282b4486c99830a99081e216f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:44:47.604467 8196 tablet_bootstrap.cc:492] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: Bootstrap starting.
I20260810 01:44:47.605690 8197 tablet_bootstrap.cc:492] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: Bootstrap starting.
I20260810 01:44:47.606519 8199 tablet_bootstrap.cc:492] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Bootstrap starting.
I20260810 01:44:47.606731 8196 tablet_bootstrap.cc:654] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:47.608054 8196 log.cc:824] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:47.608186 8199 tablet_bootstrap.cc:654] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:47.608489 8197 tablet_bootstrap.cc:654] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: Neither blocks nor log segments found. Creating new log.
I20260810 01:44:47.609237 8197 log.cc:824] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:47.609347 8199 log.cc:824] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:44:47.610175 8196 tablet_bootstrap.cc:492] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: No bootstrap required, opened a new log
I20260810 01:44:47.610366 8196 ts_tablet_manager.cc:1397] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:44:47.610996 8199 tablet_bootstrap.cc:492] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: No bootstrap required, opened a new log
I20260810 01:44:47.611116 8197 tablet_bootstrap.cc:492] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: No bootstrap required, opened a new log
I20260810 01:44:47.611164 8199 ts_tablet_manager.cc:1397] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:44:47.611308 8197 ts_tablet_manager.cc:1397] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:44:47.613894 8199 raft_consensus.cc:348] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:44:47.614094 8199 raft_consensus.cc:374] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:47.614151 8199 raft_consensus.cc:729] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcafe671eccb47b082fd8f87572e5a1d, State: Initialized, Role: FOLLOWER
I20260810 01:44:47.614069 8196 raft_consensus.cc:348] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:44:47.614357 8196 raft_consensus.cc:374] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:47.614480 8196 raft_consensus.cc:729] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 794969939b6048419449a02ce3dbbe8b, State: Initialized, Role: FOLLOWER
I20260810 01:44:47.614583 8199 consensus_queue.cc:260] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:44:47.614886 8196 consensus_queue.cc:260] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:44:47.614879 8197 raft_consensus.cc:348] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:44:47.615114 8197 raft_consensus.cc:374] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:44:47.615186 8197 raft_consensus.cc:729] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 659d0bc4d29740fe8c7bbd0b3ad15b84, State: Initialized, Role: FOLLOWER
I20260810 01:44:47.615243 7746 heartbeater.cc:503] Master 127.16.58.126:35721 was elected leader, sending a full tablet report...
I20260810 01:44:47.615557 8199 ts_tablet_manager.cc:1428] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260810 01:44:47.615587 8197 consensus_queue.cc:260] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:44:47.615981 8196 ts_tablet_manager.cc:1428] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 01:44:47.616278 8170 heartbeater.cc:503] Master 127.16.58.126:35721 was elected leader, sending a full tablet report...
I20260810 01:44:47.616714 7958 heartbeater.cc:503] Master 127.16.58.126:35721 was elected leader, sending a full tablet report...
I20260810 01:44:47.617193 8197 ts_tablet_manager.cc:1428] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
W20260810 01:44:47.627519 7747 tablet.cc:2369] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:44:47.793540 8177 tablet.cc:2369] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:44:47.832814 7959 tablet.cc:2369] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:44:47.946375 8211 raft_consensus.cc:482] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:44:47.946571 8211 raft_consensus.cc:504] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:44:47.947660 8211 leader_election.cc:288] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcafe671eccb47b082fd8f87572e5a1d (127.16.58.65:43333), 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
I20260810 01:44:47.951161 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.947980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:60803 (local address 127.16.58.65:43333)
0810 01:44:47.948105 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:47.948110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:47.948241 (+ 131us) server_negotiation.cc:407] Connection header received
0810 01:44:47.948375 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:47.948377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:47.948420 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:47.948481 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:47.948747 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.949238 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.950270 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.950649 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.950754 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.950810 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:47.950968 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 01:44:47.951037 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:44:47.951188 8212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.947860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:43333 (local address 127.16.58.66:60803)
0810 01:44:47.948156 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:47.948169 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:47.948272 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:47.948506 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:47.948508 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:47.948525 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:47.948638 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.948643 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.949342 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.949346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.950145 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.950154 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.950755 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.950759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.950852 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.950875 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:44:47.950939 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 01:44:47.951008 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":70,"threads_started":1}
I20260810 01:44:47.951229 8214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.947912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:38501 (local address 127.16.58.66:59029)
0810 01:44:47.948243 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:47.948254 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:44:47.948355 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:44:47.948579 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:44:47.948582 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:44:47.948598 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:44:47.948731 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.948736 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.949423 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.949427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.950189 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:44:47.950198 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.950811 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.950814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:44:47.950920 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.950940 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:44:47.951002 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 01:44:47.951070 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":1,"thread_start_us":86,"threads_started":1}
I20260810 01:44:47.951212 8192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:47.948017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:59029 (local address 127.16.58.67:38501)
0810 01:44:47.948150 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:47.948154 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:47.948334 (+ 180us) server_negotiation.cc:407] Connection header received
0810 01:44:47.948454 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:47.948456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:47.948497 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:47.948558 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:44:47.948839 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.949320 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.950309 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:47.950702 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:47.950805 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:47.950855 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:47.951031 (+ 176us) server_negotiation.cc:299] Negotiation successful
0810 01:44:47.951096 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 01:44:47.951751 7683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6637f0282b4486c99830a99081e216f" candidate_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcafe671eccb47b082fd8f87572e5a1d" is_pre_election: true
I20260810 01:44:47.951776 8094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6637f0282b4486c99830a99081e216f" candidate_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "794969939b6048419449a02ce3dbbe8b" is_pre_election: true
I20260810 01:44:47.952034 7683 raft_consensus.cc:2454] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 659d0bc4d29740fe8c7bbd0b3ad15b84 in term 0.
I20260810 01:44:47.952056 8094 raft_consensus.cc:2454] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 659d0bc4d29740fe8c7bbd0b3ad15b84 in term 0.
I20260810 01:44:47.952523 7782 leader_election.cc:302] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 659d0bc4d29740fe8c7bbd0b3ad15b84, 794969939b6048419449a02ce3dbbe8b, bcafe671eccb47b082fd8f87572e5a1d; no voters:
I20260810 01:44:47.952773 8211 raft_consensus.cc:2781] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:44:47.952858 8211 raft_consensus.cc:482] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:44:47.952908 8211 raft_consensus.cc:3037] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:47.953913 8211 raft_consensus.cc:504] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:44:47.954221 8211 leader_election.cc:288] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [CANDIDATE]: Term 1 election: Requested vote from peers bcafe671eccb47b082fd8f87572e5a1d (127.16.58.65:43333), 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
I20260810 01:44:47.954566 8094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6637f0282b4486c99830a99081e216f" candidate_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "794969939b6048419449a02ce3dbbe8b"
I20260810 01:44:47.954566 7683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6637f0282b4486c99830a99081e216f" candidate_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcafe671eccb47b082fd8f87572e5a1d"
I20260810 01:44:47.954685 8094 raft_consensus.cc:3037] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:47.954685 7683 raft_consensus.cc:3037] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:44:47.955907 7683 raft_consensus.cc:2454] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 659d0bc4d29740fe8c7bbd0b3ad15b84 in term 1.
I20260810 01:44:47.955907 8094 raft_consensus.cc:2454] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 659d0bc4d29740fe8c7bbd0b3ad15b84 in term 1.
I20260810 01:44:47.956197 7786 leader_election.cc:302] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 659d0bc4d29740fe8c7bbd0b3ad15b84, 794969939b6048419449a02ce3dbbe8b; no voters:
I20260810 01:44:47.956362 8211 raft_consensus.cc:2781] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:44:47.956535 8211 raft_consensus.cc:686] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 1 LEADER]: Becoming Leader. State: Replica: 659d0bc4d29740fe8c7bbd0b3ad15b84, State: Running, Role: LEADER
I20260810 01:44:47.956821 8211 consensus_queue.cc:237] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:44:47.959762 7462 catalog_manager.cc:5495] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 reported cstate change: term changed from 0 to 1, leader changed from <none> to 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } health_report { overall_health: HEALTHY } } }
I20260810 01:44:48.039011 8195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:48.035652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38372 (local address 127.16.58.66:42815)
0810 01:44:48.035783 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:44:48.035787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:44:48.035823 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:44:48.035908 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:44:48.035911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:44:48.035969 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:44:48.036058 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:44:48.036304 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:48.036801 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:48.037642 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:44:48.037861 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:44:48.037947 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:44:48.038242 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:44:48.038635 (+ 393us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:44:48.038742 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 01:44:48.038814 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 01:44:48.038874 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:44:48.044710 8094 raft_consensus.cc:1261] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [term 1 FOLLOWER]: Refusing update from remote peer 659d0bc4d29740fe8c7bbd0b3ad15b84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:48.044710 7683 raft_consensus.cc:1261] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Refusing update from remote peer 659d0bc4d29740fe8c7bbd0b3ad15b84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:44:48.045397 8211 consensus_queue.cc:1035] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:48.045629 8215 consensus_queue.cc:1035] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:44:48.053588 8223 mvcc.cc:205] Tried to move back new op lower bound from 7316792475823443968 to 7316792475473399808. Current Snapshot: MvccSnapshot[applied={T|T < 7316792475823443968}]
I20260810 01:44:48.055387 8221 mvcc.cc:205] Tried to move back new op lower bound from 7316792475823443968 to 7316792475473399808. Current Snapshot: MvccSnapshot[applied={T|T < 7316792475823443968}]
I20260810 01:44:48.059521 7460 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:44:48.059664 7460 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:44:48.061973 7460 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Sending DeleteTablet for 3 replicas of tablet a6637f0282b4486c99830a99081e216f
I20260810 01:44:48.062691 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 7560
I20260810 01:44:48.062687 7651 tablet_service.cc:1514] Processing DeleteTablet for tablet a6637f0282b4486c99830a99081e216f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:48 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:52344
I20260810 01:44:48.062891 7861 tablet_service.cc:1514] Processing DeleteTablet for tablet a6637f0282b4486c99830a99081e216f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:48 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:38358
I20260810 01:44:48.063270 8232 tablet_replica.cc:330] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: stopping tablet replica
I20260810 01:44:48.063235 8064 tablet_service.cc:1514] Processing DeleteTablet for tablet a6637f0282b4486c99830a99081e216f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:48 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:46168
I20260810 01:44:48.063542 8232 raft_consensus.cc:2229] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:44:48.063624 8233 tablet_replica.cc:330] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: stopping tablet replica
I20260810 01:44:48.063879 8233 raft_consensus.cc:2229] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:44:48.063989 8232 raft_consensus.cc:2258] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:48.064095 8233 raft_consensus.cc:2258] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:44:48.068876 8233 ts_tablet_manager.cc:1905] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:44:48.069979 8232 ts_tablet_manager.cc:1905] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:44:48.071702 8233 ts_tablet_manager.cc:1918] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:44:48.071823 8233 log.cc:1196] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/a6637f0282b4486c99830a99081e216f
I20260810 01:44:48.072235 8233 ts_tablet_manager.cc:1939] T a6637f0282b4486c99830a99081e216f P 794969939b6048419449a02ce3dbbe8b: Deleting consensus metadata
I20260810 01:44:48.073468 7444 catalog_manager.cc:4841] TS 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501): tablet a6637f0282b4486c99830a99081e216f (table test-table [id=90bcf4a45bd54468a67e2a8438a77fa7]) successfully deleted
I20260810 01:44:48.077162 8232 ts_tablet_manager.cc:1918] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:44:48.077261 8232 log.cc:1196] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/a6637f0282b4486c99830a99081e216f
I20260810 01:44:48.077610 8232 ts_tablet_manager.cc:1939] T a6637f0282b4486c99830a99081e216f P 659d0bc4d29740fe8c7bbd0b3ad15b84: Deleting consensus metadata
W20260810 01:44:48.078352 7439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:43333 (error 108)
I20260810 01:44:48.078655 7444 catalog_manager.cc:4841] TS 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815): tablet a6637f0282b4486c99830a99081e216f (table test-table [id=90bcf4a45bd54468a67e2a8438a77fa7]) successfully deleted
I20260810 01:44:48.079092 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 7754
I20260810 01:44:48.080657 8190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:44:48.079184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:43333 (local address 127.0.0.1:52346)
0810 01:44:48.080474 (+ 1290us) negotiation.cc:107] Waiting for socket to connect
0810 01:44:48.080560 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:43333: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1197}
W20260810 01:44:48.083691 7439 catalog_manager.cc:4584] TS bcafe671eccb47b082fd8f87572e5a1d (127.16.58.65:43333): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a6637f0282b4486c99830a99081e216f: Network error: Client connection negotiation failed: client connection to 127.16.58.65:43333: connect: Connection refused (error 111)
I20260810 01:44:48.095598 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 7968
I20260810 01:44:48.103370 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 7419
I20260810 01:45:08.113270 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35721
--webserver_interface=127.16.58.126
--webserver_port=33121
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:35721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:08.227254 8238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:08.227494 8238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:08.227556 8238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:08.231428 8238 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 01:45:08.231473 8238 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 01:45:08.231511 8238 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 01:45:08.231539 8238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:08.231566 8238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:08.231598 8238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:08.231622 8238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:08.231650 8238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:08.236675 8238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:35721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=33121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:08.237571 8238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:08.238471 8238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:08.251195 8252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:08.251219 8250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:08.251195 8248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:08.251420 8238 server_base.cc:1034] running on GCE node
I20260810 01:45:08.252144 8238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:08.253218 8238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:08.254376 8238 hybrid_clock.cc:648] HybridClock initialized: now 1786326308254359 us; error 33 us; skew 500 ppm
Aug 10 01:45:08 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326308, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:08.259671 8238 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:45:08.260532 8238 webserver.cc:460] Webserver started at http://127.16.58.126:33121/ using document root <none> and password file <none>
I20260810 01:45:08.261044 8238 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:08.261112 8238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:08.264837 8238 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260810 01:45:08.266875 8264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:08.268131 8238 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:08.268234 8238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "8152a7df51ed47ee80057a28123cefd5"
format_stamp: "Formatted at 2026-08-10 01:44:46 on dist-test-slave-jlzn"
server_key: "a8e3f22f30eafbcbe49280fe0a92d0bc"
server_key_iv: "1525cb64fdb83f340da482591550757b"
server_key_version: "encryptionkey@0"
I20260810 01:45:08.268769 8238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:08.291587 8238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:08.294135 8238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:08.294282 8238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:08.301149 8238 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:35721
I20260810 01:45:08.301420 8350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:35721 every 8 connection(s)
I20260810 01:45:08.302171 8238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:08.306602 8352 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:45:08.308270 8352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Bootstrap starting.
I20260810 01:45:08.310979 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 8238
I20260810 01:45:08.311470 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:43333
--local_ip_for_outbound_sockets=127.16.58.65
--tserver_master_addrs=127.16.58.126:35721
--webserver_port=32815
--webserver_interface=127.16.58.65
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:45:08.329878 8352 log.cc:824] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:08.340909 8352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:45:08.341300 8352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Bootstrap complete.
I20260810 01:45:08.346635 8352 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:45:08.347139 8352 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8152a7df51ed47ee80057a28123cefd5, State: Initialized, Role: FOLLOWER
I20260810 01:45:08.347692 8352 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:45:08.347882 8352 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:08.347963 8352 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:08.348060 8352 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 1 FOLLOWER]: Advancing to term 2
I20260810 01:45:08.350382 8352 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:45:08.350749 8352 leader_election.cc:302] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8152a7df51ed47ee80057a28123cefd5; no voters:
I20260810 01:45:08.351065 8352 leader_election.cc:288] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 01:45:08.351191 8357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 01:45:08.351409 8357 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 2 LEADER]: Becoming Leader. State: Replica: 8152a7df51ed47ee80057a28123cefd5, State: Running, Role: LEADER
I20260810 01:45:08.351766 8357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:45:08.352385 8352 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:08.353152 8363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8152a7df51ed47ee80057a28123cefd5. Latest consensus state: current_term: 2 leader_uuid: "8152a7df51ed47ee80057a28123cefd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } } }
I20260810 01:45:08.353286 8363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:08.353534 8360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8152a7df51ed47ee80057a28123cefd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } } }
I20260810 01:45:08.353622 8360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:08.354238 8371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:08.359721 8371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:08.360371 8371 catalog_manager.cc:1259] Loaded cluster ID: ad4d235a58914559b70535647fa83b71
I20260810 01:45:08.360433 8371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:08.362934 8371 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:08.363629 8371 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Loaded TSK: 0
I20260810 01:45:08.391014 8371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Generated new TSK 1
I20260810 01:45:08.391268 8371 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:45:08.442240 8355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:08.442468 8355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:08.442508 8355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:08.446498 8355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:08.446555 8355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:08.446607 8355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:45:08.451565 8355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:43333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=32815
--tserver_master_addrs=127.16.58.126:35721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:08.452503 8355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:08.453481 8355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:08.462553 8399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:08.462579 8403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:08.462569 8398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:08.462987 8355 server_base.cc:1034] running on GCE node
I20260810 01:45:08.463342 8355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:08.463960 8355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:08.465137 8355 hybrid_clock.cc:648] HybridClock initialized: now 1786326308465128 us; error 31 us; skew 500 ppm
Aug 10 01:45:08 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326308, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:08.467993 8355 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:45:08.468801 8355 webserver.cc:460] Webserver started at http://127.16.58.65:32815/ using document root <none> and password file <none>
I20260810 01:45:08.469324 8355 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:08.469410 8355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:08.473203 8355 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:45:08.475277 8414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:08.476490 8355 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:08.476596 8355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "bcafe671eccb47b082fd8f87572e5a1d"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "ff6f70b38368c8959c407db107d7296a"
server_key_iv: "29f5837a7d34f1f7bf722952d8059ee2"
server_key_version: "encryptionkey@0"
I20260810 01:45:08.477093 8355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:08.489918 8355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:08.492483 8355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:08.492651 8355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:08.493191 8355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:08.494179 8426 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 01:45:08.498011 8355 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 01:45:08.498066 8355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260810 01:45:08.498142 8355 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 01:45:08.499670 8355 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 01:45:08.499713 8355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 01:45:08.500012 8426 tablet_bootstrap.cc:492] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Bootstrap starting.
I20260810 01:45:08.508872 8355 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:43333
I20260810 01:45:08.508939 8575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:43333 every 8 connection(s)
I20260810 01:45:08.509806 8355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:45:08.510046 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 8355
I20260810 01:45:08.510536 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:42815
--local_ip_for_outbound_sockets=127.16.58.66
--tserver_master_addrs=127.16.58.126:35721
--webserver_port=34473
--webserver_interface=127.16.58.66
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:45:08.519415 8426 log.cc:824] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:45:08 dist-test-slave-jlzn krb5kdc[7400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326308, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:08.525445 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.511725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:49523 (local address 127.16.58.126:35721)
0810 01:45:08.512234 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.512254 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.512677 (+ 423us) server_negotiation.cc:407] Connection header received
0810 01:45:08.513997 (+ 1320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.514018 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.514426 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.514783 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:08.515773 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.516781 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.517962 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.518424 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.518568 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.520905 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:08.520910 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:08.520922 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:08.520948 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:08.522482 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.522968 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.522973 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.522977 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.523095 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.523420 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.523423 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.523424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.523752 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:08.523908 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.524398 (+ 490us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.524653 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":150,"threads_started":1}
I20260810 01:45:08.525457 8583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.511730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:49523)
0810 01:45:08.512505 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:08.512556 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:08.513494 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:08.514830 (+ 1336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:08.514836 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:08.515151 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:08.515599 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.515612 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.516933 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.516936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.517843 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.517853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.518538 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.518541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.518733 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.519266 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:08.519282 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:08.520727 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:08.522592 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:08.522598 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:08.522610 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:08.522860 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:08.523196 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:08.523199 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:08.523201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:08.523331 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:08.523880 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:08.523886 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:08.524106 (+ 220us) client_negotiation.cc:769] Sending connection context
0810 01:45:08.524265 (+ 159us) client_negotiation.cc:240] Negotiation successful
0810 01:45:08.524583 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":138,"threads_started":1}
I20260810 01:45:08.527863 8426 tablet_bootstrap.cc:492] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:45:08.528021 8576 heartbeater.cc:347] Connected to a master server at 127.16.58.126:35721
I20260810 01:45:08.528218 8576 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:08.528236 8426 tablet_bootstrap.cc:492] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Bootstrap complete.
I20260810 01:45:08.528656 8576 heartbeater.cc:511] Master 127.16.58.126:35721 requested a full tablet report, sending...
I20260810 01:45:08.529645 8426 ts_tablet_manager.cc:1397] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Time spent bootstrapping tablet: real 0.030s user 0.024s sys 0.004s
I20260810 01:45:08.530812 8291 ts_manager.cc:194] Registered new tserver with Master: bcafe671eccb47b082fd8f87572e5a1d (127.16.58.65:43333)
I20260810 01:45:08.532431 8426 raft_consensus.cc:348] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:45:08.532931 8426 raft_consensus.cc:729] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcafe671eccb47b082fd8f87572e5a1d, State: Initialized, Role: FOLLOWER
I20260810 01:45:08.533511 8426 consensus_queue.cc:260] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } }
I20260810 01:45:08.534065 8291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:49523
I20260810 01:45:08.534545 8426 ts_tablet_manager.cc:1428] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:45:08.536726 8576 heartbeater.cc:503] Master 127.16.58.126:35721 was elected leader, sending a full tablet report...
I20260810 01:45:08.540529 8590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.534121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55524 (local address 127.16.58.65:43333)
0810 01:45:08.535850 (+ 1729us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.535892 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.535918 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:45:08.536306 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.536311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.536564 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.536796 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:08.537311 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.538286 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.539333 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.539903 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.539996 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.540124 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.540306 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.540388 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":805,"thread_start_us":109,"threads_started":1}
I20260810 01:45:08.540546 8587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.533428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:43333 (local address 127.0.0.1:55524)
0810 01:45:08.534573 (+ 1145us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:08.534612 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:08.536072 (+ 1460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:08.536937 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:08.536942 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:08.536964 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:08.537075 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.537081 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.538384 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.538387 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.539220 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.539229 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.540008 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.540011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.540121 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.540174 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 01:45:08.540265 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 01:45:08.540385 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":986,"thread_start_us":109,"threads_started":1}
I20260810 01:45:08.541450 8482 tablet_service.cc:1514] Processing DeleteTablet for tablet a6637f0282b4486c99830a99081e216f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:44:48 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:55524
I20260810 01:45:08.542178 8591 tablet_replica.cc:330] stopping tablet replica
I20260810 01:45:08.542433 8591 raft_consensus.cc:2229] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:08.542641 8591 raft_consensus.cc:2258] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:08.543464 8591 ts_tablet_manager.cc:1905] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:08.546865 8591 ts_tablet_manager.cc:1918] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:08.546942 8591 log.cc:1196] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal/wals/a6637f0282b4486c99830a99081e216f
I20260810 01:45:08.547174 8591 ts_tablet_manager.cc:1939] T a6637f0282b4486c99830a99081e216f P bcafe671eccb47b082fd8f87572e5a1d: Deleting consensus metadata
I20260810 01:45:08.548657 8265 catalog_manager.cc:4841] TS bcafe671eccb47b082fd8f87572e5a1d (127.16.58.65:43333): tablet a6637f0282b4486c99830a99081e216f (table test-table [id=90bcf4a45bd54468a67e2a8438a77fa7]) successfully deleted
W20260810 01:45:08.628506 8585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:08.628738 8585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:08.628783 8585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:08.632654 8585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:08.632701 8585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:08.632754 8585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:45:08.637636 8585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:42815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=34473
--tserver_master_addrs=127.16.58.126:35721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:08.638480 8585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:08.639415 8585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:08.648241 8596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:08.648253 8603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:08.648253 8599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:08.648495 8585 server_base.cc:1034] running on GCE node
I20260810 01:45:08.648864 8585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:08.649435 8585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:08.650580 8585 hybrid_clock.cc:648] HybridClock initialized: now 1786326308650554 us; error 44 us; skew 500 ppm
Aug 10 01:45:08 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326308, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:08.653227 8585 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:45:08.654076 8585 webserver.cc:460] Webserver started at http://127.16.58.66:34473/ using document root <none> and password file <none>
I20260810 01:45:08.654606 8585 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:08.654692 8585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:08.658238 8585 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:08.660148 8611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:08.661247 8585 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:08.661350 8585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "0647b925294f0f078fce009da2ff013b"
server_key_iv: "7c9e3054478aedc88e319e45c0815490"
server_key_version: "encryptionkey@0"
I20260810 01:45:08.661850 8585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:08.672952 8585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:08.675757 8585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:08.675951 8585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:08.676472 8585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:08.677239 8585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:08.677286 8585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:08.677336 8585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:08.677361 8585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:08.685637 8585 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:42815
I20260810 01:45:08.685665 8778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:42815 every 8 connection(s)
I20260810 01:45:08.686512 8585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:45:08.689733 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 8585
I20260810 01:45:08.690116 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:38501
--local_ip_for_outbound_sockets=127.16.58.67
--tserver_master_addrs=127.16.58.126:35721
--webserver_port=34723
--webserver_interface=127.16.58.67
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 01:45:08 dist-test-slave-jlzn krb5kdc[7400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326308, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:08.700220 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.688138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:51097 (local address 127.16.58.126:35721)
0810 01:45:08.688265 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.688269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.689024 (+ 755us) server_negotiation.cc:407] Connection header received
0810 01:45:08.690330 (+ 1306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.690335 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.690392 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.690435 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:08.691701 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.692290 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.693819 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.694039 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.694110 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.696853 (+ 2743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:08.696857 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:08.696859 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:08.696884 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:08.698289 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.698781 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.698784 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.698785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.698865 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.699183 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.699186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.699188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.699363 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:08.699448 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.699917 (+ 469us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.700052 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:45:08.700920 8784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.688463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:51097)
0810 01:45:08.688875 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:08.688915 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:08.690110 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:08.690755 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:08.690761 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:08.691077 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:08.691520 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.691534 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.692417 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.692421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.693714 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.693725 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.694178 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.694182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.694367 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.694889 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:08.694910 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:08.696683 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:08.698412 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:08.698417 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:08.698431 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:08.698684 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:08.698947 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:08.698950 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:08.698952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:08.699094 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:08.699462 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:08.699469 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:08.699680 (+ 211us) client_negotiation.cc:769] Sending connection context
0810 01:45:08.699873 (+ 193us) client_negotiation.cc:240] Negotiation successful
0810 01:45:08.700175 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":112,"threads_started":1}
I20260810 01:45:08.701985 8779 heartbeater.cc:347] Connected to a master server at 127.16.58.126:35721
I20260810 01:45:08.702235 8779 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:08.702745 8779 heartbeater.cc:511] Master 127.16.58.126:35721 requested a full tablet report, sending...
I20260810 01:45:08.703838 8291 ts_manager.cc:194] Registered new tserver with Master: 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815)
I20260810 01:45:08.704581 8291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:51097
W20260810 01:45:08.801669 8787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:08.801900 8787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:08.801939 8787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:08.805764 8787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:08.805811 8787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:08.805862 8787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:45:08.810781 8787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:38501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=34723
--tserver_master_addrs=127.16.58.126:35721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:08.811640 8787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:08.812573 8787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:08.821290 8794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:08.821295 8797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:08.821295 8795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:08.821599 8787 server_base.cc:1034] running on GCE node
I20260810 01:45:08.821960 8787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:08.822530 8787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:08.823686 8787 hybrid_clock.cc:648] HybridClock initialized: now 1786326308823665 us; error 31 us; skew 500 ppm
Aug 10 01:45:08 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326308, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:08.826171 8787 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:45:08.827020 8787 webserver.cc:460] Webserver started at http://127.16.58.67:34723/ using document root <none> and password file <none>
I20260810 01:45:08.827525 8787 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:08.827611 8787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:08.831161 8787 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:08.833127 8805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:08.834283 8787 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:45:08.834396 8787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "794969939b6048419449a02ce3dbbe8b"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "2a91a512977c4e54b3db479d1b4e589a"
server_key_iv: "d8dedb9e647a6284e5857cf5aac8cdf5"
server_key_version: "encryptionkey@0"
I20260810 01:45:08.834906 8787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:08.850030 8787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:08.852674 8787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:08.852867 8787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:08.853485 8787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:08.854276 8787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:08.854342 8787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:08.854396 8787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:08.854416 8787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:08.862702 8787 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:38501
I20260810 01:45:08.862727 8984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:38501 every 8 connection(s)
I20260810 01:45:08.863628 8787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:45:08.867344 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 8787
Aug 10 01:45:08 dist-test-slave-jlzn krb5kdc[7400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326308, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:08.877106 8989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.868013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32980 (local address 127.16.58.126:35721)
0810 01:45:08.868949 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.868954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.868968 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:45:08.869012 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.869015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.869061 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.869170 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:08.870242 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.871005 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.872249 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.872602 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.872712 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.874198 (+ 1486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:08.874201 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:08.874203 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:08.874225 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:08.875482 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.875909 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.875913 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.875915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.876006 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.876253 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.876256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.876258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.876475 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:08.876693 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.876820 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.876926 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":863,"thread_start_us":63,"threads_started":1}
I20260810 01:45:08.879393 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.865580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:54537 (local address 127.16.58.126:35721)
0810 01:45:08.865739 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.865744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.866709 (+ 965us) server_negotiation.cc:407] Connection header received
0810 01:45:08.869302 (+ 2593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.869305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.869341 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.869397 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:08.870933 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.871784 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.873360 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.873686 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.873793 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.876151 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:08.876154 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:08.876157 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:08.876179 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:08.877516 (+ 1337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.878025 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.878029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.878031 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.878111 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.878418 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.878421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.878423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.878582 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:08.878666 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.879123 (+ 457us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.879251 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 01:45:08.880179 8987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.865981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:54537)
0810 01:45:08.866528 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:08.866583 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:08.869081 (+ 2498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:08.869558 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:08.869567 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:08.870048 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:08.870663 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.870680 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.871978 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.871982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.873246 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.873256 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.873817 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.873820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.873950 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.874426 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:08.874446 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:08.875990 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:08.877648 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:08.877654 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:08.877667 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:08.877946 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:08.878197 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:08.878200 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:08.878202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:08.878332 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:08.878685 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:08.878691 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:08.878906 (+ 215us) client_negotiation.cc:769] Sending connection context
0810 01:45:08.879061 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 01:45:08.879360 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":146,"threads_started":1}
I20260810 01:45:08.881148 8985 heartbeater.cc:347] Connected to a master server at 127.16.58.126:35721
I20260810 01:45:08.881349 8985 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:08.881779 8985 heartbeater.cc:511] Master 127.16.58.126:35721 requested a full tablet report, sending...
I20260810 01:45:08.882658 8291 ts_manager.cc:194] Registered new tserver with Master: 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
I20260810 01:45:08.883153 8291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:54537
I20260810 01:45:08.890177 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:45:08.894004 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.890745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32992 (local address 127.16.58.126:35721)
0810 01:45:08.890847 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.890852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.891061 (+ 209us) server_negotiation.cc:407] Connection header received
0810 01:45:08.891208 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.891210 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.891296 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.891376 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:45:08.891609 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.892172 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.893003 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.893209 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.893292 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.893559 (+ 267us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:45:08.893674 (+ 115us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 01:45:08.893893 (+ 219us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:32992: token expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260810 01:45:08.894064 8582 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:32992: token expired
W20260810 01:45:08.894374 8183 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.16.58.126:35721)
I20260810 01:45:08.900624 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.894690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33004 (local address 127.16.58.126:35721)
0810 01:45:08.894790 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.894794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.894806 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:45:08.894910 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.894913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.894948 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.895002 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:08.895554 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.896054 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.896798 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.896992 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.897071 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.898173 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:08.898176 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:08.898178 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:08.898198 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:08.899160 (+ 962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.899522 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.899525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.899527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.899600 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:08.899876 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:08.899880 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:08.899881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:08.900065 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:08.900190 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.900398 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.900495 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:45:08.902678 8291 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33004:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:45:08.905794 8291 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:45:08.912863 8482 tablet_service.cc:1467] Processing CreateTablet for tablet 63d5d87effea48128023ee352c9dec18 (DEFAULT_TABLE table=test-table [id=e5dd9bc7286345039d916257a88319bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:08.913511 8482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63d5d87effea48128023ee352c9dec18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:08.916481 8587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.911760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42815 (local address 127.0.0.1:57252)
0810 01:45:08.911936 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:08.911949 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:08.912014 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:08.913028 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:08.913031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:08.913048 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:08.913131 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.913138 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.914410 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.914413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.915205 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.915215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.916094 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.916098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.916189 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.916211 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:45:08.916290 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 01:45:08.916361 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":1}
I20260810 01:45:08.916685 8426 tablet_bootstrap.cc:492] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Bootstrap starting.
I20260810 01:45:08.916780 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.912212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57252 (local address 127.16.58.66:42815)
0810 01:45:08.912573 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.912585 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.912607 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:45:08.912681 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.912687 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.912883 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.913048 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:08.913229 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.914257 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.915328 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.915965 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.916072 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.916223 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.916520 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.916625 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":144,"threads_started":1}
I20260810 01:45:08.917131 8996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.911999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:38501 (local address 127.0.0.1:56902)
0810 01:45:08.912220 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:08.912233 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:08.912302 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:08.913160 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:08.913163 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:08.913179 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:08.913250 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.913256 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.914653 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.914657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.915707 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.915719 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.916791 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.916795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.916884 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.916908 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:45:08.916959 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 01:45:08.917016 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":89,"threads_started":1}
I20260810 01:45:08.917484 8426 tablet_bootstrap.cc:654] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:08.917577 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.912514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56902 (local address 127.16.58.67:38501)
0810 01:45:08.912779 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.912789 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.912807 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:45:08.912862 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.912866 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.913005 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.913381 (+ 376us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:08.913510 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.914534 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.915860 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.916655 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.917266 (+ 611us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.917368 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.917407 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.917471 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":86,"threads_started":1}
I20260810 01:45:08.918488 8426 tablet_bootstrap.cc:492] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: No bootstrap required, opened a new log
I20260810 01:45:08.918581 8426 ts_tablet_manager.cc:1397] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 01:45:08.919173 8426 raft_consensus.cc:348] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:08.919273 8426 raft_consensus.cc:374] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:08.919312 8426 raft_consensus.cc:729] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcafe671eccb47b082fd8f87572e5a1d, State: Initialized, Role: FOLLOWER
I20260810 01:45:08.919436 8426 consensus_queue.cc:260] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:08.919682 8426 ts_tablet_manager.cc:1428] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 01:45:08.920641 8878 tablet_service.cc:1467] Processing CreateTablet for tablet 63d5d87effea48128023ee352c9dec18 (DEFAULT_TABLE table=test-table [id=e5dd9bc7286345039d916257a88319bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:08.920648 8681 tablet_service.cc:1467] Processing CreateTablet for tablet 63d5d87effea48128023ee352c9dec18 (DEFAULT_TABLE table=test-table [id=e5dd9bc7286345039d916257a88319bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:08.921733 8681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63d5d87effea48128023ee352c9dec18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:08.921746 8878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63d5d87effea48128023ee352c9dec18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:08.929582 9008 tablet_bootstrap.cc:492] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: Bootstrap starting.
I20260810 01:45:08.930035 9009 tablet_bootstrap.cc:492] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: Bootstrap starting.
I20260810 01:45:08.931883 9008 tablet_bootstrap.cc:654] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:08.932588 9009 tablet_bootstrap.cc:654] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:08.933243 9008 log.cc:824] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:08.933362 9009 log.cc:824] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:08.935287 9009 tablet_bootstrap.cc:492] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: No bootstrap required, opened a new log
I20260810 01:45:08.935287 9008 tablet_bootstrap.cc:492] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: No bootstrap required, opened a new log
I20260810 01:45:08.935480 9009 ts_tablet_manager.cc:1397] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:45:08.935480 9008 ts_tablet_manager.cc:1397] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 01:45:08.939278 9009 raft_consensus.cc:348] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:08.939303 9008 raft_consensus.cc:348] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:08.939560 9008 raft_consensus.cc:374] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:08.939560 9009 raft_consensus.cc:374] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:08.939620 9009 raft_consensus.cc:729] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 659d0bc4d29740fe8c7bbd0b3ad15b84, State: Initialized, Role: FOLLOWER
I20260810 01:45:08.939628 9008 raft_consensus.cc:729] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 794969939b6048419449a02ce3dbbe8b, State: Initialized, Role: FOLLOWER
I20260810 01:45:08.940099 9008 consensus_queue.cc:260] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:08.940099 9009 consensus_queue.cc:260] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:08.940729 8985 heartbeater.cc:503] Master 127.16.58.126:35721 was elected leader, sending a full tablet report...
I20260810 01:45:08.940936 8779 heartbeater.cc:503] Master 127.16.58.126:35721 was elected leader, sending a full tablet report...
I20260810 01:45:08.941085 9008 ts_tablet_manager.cc:1428] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:45:08.941085 9009 ts_tablet_manager.cc:1428] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:45:08.985405 8588 raft_consensus.cc:482] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:08.985611 8588 raft_consensus.cc:504] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:08.986701 8588 leader_election.cc:288] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815), 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
I20260810 01:45:08.990435 8583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.986907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42815 (local address 127.16.58.65:49305)
0810 01:45:08.987030 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:08.987045 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:08.987136 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:08.987459 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:08.987462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:08.987481 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:08.987600 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.987608 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.988485 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.988488 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.989367 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.989377 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.990028 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.990032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.990153 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.990177 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:45:08.990239 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 01:45:08.990308 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":22}
I20260810 01:45:08.990475 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.986994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:49305 (local address 127.16.58.66:42815)
0810 01:45:08.987108 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.987112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.987126 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:45:08.987231 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.987235 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.987285 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.987353 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:08.987732 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.988377 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.989493 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.989910 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.990001 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.990047 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.990280 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.990350 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:45:08.990691 9004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.987352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:41511 (local address 127.16.58.67:38501)
0810 01:45:08.987481 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:08.987485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:08.987585 (+ 100us) server_negotiation.cc:407] Connection header received
0810 01:45:08.987679 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:08.987682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:08.987731 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:08.987786 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:08.988069 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.988585 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.989569 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.989978 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.990086 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.990134 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:08.990493 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 01:45:08.990568 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 01:45:08.991001 9014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:08.987200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:38501 (local address 127.16.58.65:41511)
0810 01:45:08.987502 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:08.987513 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:08.987602 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:08.987834 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:08.987836 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:08.987854 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:08.987977 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.987983 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.988693 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.988696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.989450 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:08.989460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:08.990114 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:08.990117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:08.990190 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:08.990208 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 01:45:08.990815 (+ 607us) client_negotiation.cc:240] Negotiation successful
0810 01:45:08.990885 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":96,"threads_started":1}
I20260810 01:45:08.991214 8708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63d5d87effea48128023ee352c9dec18" candidate_uuid: "bcafe671eccb47b082fd8f87572e5a1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" is_pre_election: true
I20260810 01:45:08.991547 8708 raft_consensus.cc:2454] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcafe671eccb47b082fd8f87572e5a1d in term 0.
I20260810 01:45:08.991689 8911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63d5d87effea48128023ee352c9dec18" candidate_uuid: "bcafe671eccb47b082fd8f87572e5a1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "794969939b6048419449a02ce3dbbe8b" is_pre_election: true
I20260810 01:45:08.991994 8911 raft_consensus.cc:2454] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcafe671eccb47b082fd8f87572e5a1d in term 0.
I20260810 01:45:08.992048 8419 leader_election.cc:302] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 659d0bc4d29740fe8c7bbd0b3ad15b84, bcafe671eccb47b082fd8f87572e5a1d; no voters:
I20260810 01:45:08.992342 8588 raft_consensus.cc:2781] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:45:08.992429 8588 raft_consensus.cc:482] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:45:08.992481 8588 raft_consensus.cc:3037] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:08.993517 8588 raft_consensus.cc:504] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:08.993827 8588 leader_election.cc:288] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 1 election: Requested vote from peers 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815), 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
I20260810 01:45:08.994171 8911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63d5d87effea48128023ee352c9dec18" candidate_uuid: "bcafe671eccb47b082fd8f87572e5a1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "794969939b6048419449a02ce3dbbe8b"
I20260810 01:45:08.994184 8708 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63d5d87effea48128023ee352c9dec18" candidate_uuid: "bcafe671eccb47b082fd8f87572e5a1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84"
I20260810 01:45:08.994270 8911 raft_consensus.cc:3037] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:08.994288 8708 raft_consensus.cc:3037] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:08.995260 8708 raft_consensus.cc:2454] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcafe671eccb47b082fd8f87572e5a1d in term 1.
I20260810 01:45:08.995268 8911 raft_consensus.cc:2454] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcafe671eccb47b082fd8f87572e5a1d in term 1.
I20260810 01:45:08.995524 8419 leader_election.cc:302] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 659d0bc4d29740fe8c7bbd0b3ad15b84, bcafe671eccb47b082fd8f87572e5a1d; no voters:
I20260810 01:45:08.995687 8588 raft_consensus.cc:2781] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:08.995922 8588 raft_consensus.cc:686] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 LEADER]: Becoming Leader. State: Replica: bcafe671eccb47b082fd8f87572e5a1d, State: Running, Role: LEADER
I20260810 01:45:08.996160 8588 consensus_queue.cc:237] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:08.998889 8291 catalog_manager.cc:5495] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d reported cstate change: term changed from 0 to 1, leader changed from <none> to bcafe671eccb47b082fd8f87572e5a1d (127.16.58.65). New cstate: current_term: 1 leader_uuid: "bcafe671eccb47b082fd8f87572e5a1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } health_report { overall_health: HEALTHY } } }
W20260810 01:45:09.011111 8580 tablet.cc:2369] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:45:09.017341 8590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:09.014411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55538 (local address 127.16.58.65:43333)
0810 01:45:09.014528 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:09.014532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:09.014546 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:45:09.014655 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:09.014658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:09.014708 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:09.014790 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:45:09.014958 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:09.015432 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:09.016185 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:09.016402 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:09.016471 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:09.016650 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:45:09.017038 (+ 388us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:45:09.017116 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:09.017163 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 01:45:09.017211 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:45:09.020929 8708 raft_consensus.cc:1261] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 1 FOLLOWER]: Refusing update from remote peer bcafe671eccb47b082fd8f87572e5a1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:09.020931 8911 raft_consensus.cc:1261] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [term 1 FOLLOWER]: Refusing update from remote peer bcafe671eccb47b082fd8f87572e5a1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:09.021535 8588 consensus_queue.cc:1035] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:09.021718 9017 consensus_queue.cc:1035] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:09.037253 8290 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:09.037429 8290 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33004:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:09.039719 8290 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Sending DeleteTablet for 3 replicas of tablet 63d5d87effea48128023ee352c9dec18
I20260810 01:45:09.040396 8482 tablet_service.cc:1514] Processing DeleteTablet for tablet 63d5d87effea48128023ee352c9dec18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:09 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:55524
I20260810 01:45:09.040386 8681 tablet_service.cc:1514] Processing DeleteTablet for tablet 63d5d87effea48128023ee352c9dec18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:09 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:57252
I20260810 01:45:09.040539 8878 tablet_service.cc:1514] Processing DeleteTablet for tablet 63d5d87effea48128023ee352c9dec18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:09 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:56902
I20260810 01:45:09.040774 8591 tablet_replica.cc:330] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: stopping tablet replica
I20260810 01:45:09.040887 8591 raft_consensus.cc:2229] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:45:09.040985 9039 tablet_replica.cc:330] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: stopping tablet replica
I20260810 01:45:09.041167 8591 raft_consensus.cc:2258] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:09.041285 9039 raft_consensus.cc:2229] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:09.041512 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 8355
I20260810 01:45:09.041635 9039 raft_consensus.cc:2258] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:09.053284 9038 tablet_replica.cc:330] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: stopping tablet replica
I20260810 01:45:09.053418 9039 ts_tablet_manager.cc:1905] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:09.053617 9038 raft_consensus.cc:2229] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:09.053918 9038 raft_consensus.cc:2258] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:09.055173 9038 ts_tablet_manager.cc:1905] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:09.056294 9039 ts_tablet_manager.cc:1918] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:09.056394 9039 log.cc:1196] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/63d5d87effea48128023ee352c9dec18
I20260810 01:45:09.056758 9039 ts_tablet_manager.cc:1939] T 63d5d87effea48128023ee352c9dec18 P 794969939b6048419449a02ce3dbbe8b: Deleting consensus metadata
I20260810 01:45:09.057359 9038 ts_tablet_manager.cc:1918] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:09.057444 9038 log.cc:1196] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/63d5d87effea48128023ee352c9dec18
I20260810 01:45:09.057726 9038 ts_tablet_manager.cc:1939] T 63d5d87effea48128023ee352c9dec18 P 659d0bc4d29740fe8c7bbd0b3ad15b84: Deleting consensus metadata
I20260810 01:45:09.058032 8269 catalog_manager.cc:4841] TS 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501): tablet 63d5d87effea48128023ee352c9dec18 (table test-table [id=e5dd9bc7286345039d916257a88319bd]) successfully deleted
I20260810 01:45:09.058701 8269 catalog_manager.cc:4841] TS 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815): tablet 63d5d87effea48128023ee352c9dec18 (table test-table [id=e5dd9bc7286345039d916257a88319bd]) successfully deleted
W20260810 01:45:09.060230 8265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:43333 (error 108)
I20260810 01:45:09.061036 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 8585
I20260810 01:45:09.061172 8996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:09.060898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:43333 (local address 127.0.0.1:55546)
0810 01:45:09.061017 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:09.061073 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:43333: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 01:45:09.064796 8265 catalog_manager.cc:4584] TS bcafe671eccb47b082fd8f87572e5a1d (127.16.58.65:43333): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 63d5d87effea48128023ee352c9dec18: Network error: Client connection negotiation failed: client connection to 127.16.58.65:43333: connect: Connection refused (error 111)
I20260810 01:45:09.072492 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 8787
I20260810 01:45:09.082386 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 8238
I20260810 01:45:29.093958 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35721
--webserver_interface=127.16.58.126
--webserver_port=33121
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:35721
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:29.205240 9041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:29.205472 9041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:29.205513 9041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:29.209355 9041 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 01:45:29.209396 9041 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 01:45:29.209410 9041 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 01:45:29.209424 9041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:29.209453 9041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:29.209486 9041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:29.209511 9041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:29.209547 9041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:29.214524 9041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:35721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=33121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:29.215426 9041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:29.216372 9041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:29.224700 9052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:29.224710 9051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:29.224753 9041 server_base.cc:1034] running on GCE node
W20260810 01:45:29.224933 9057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:29.225495 9041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:29.226513 9041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:29.227686 9041 hybrid_clock.cc:648] HybridClock initialized: now 1786326329227670 us; error 26 us; skew 500 ppm
Aug 10 01:45:29 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326329, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:29.233180 9041 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:45:29.234035 9041 webserver.cc:460] Webserver started at http://127.16.58.126:33121/ using document root <none> and password file <none>
I20260810 01:45:29.234565 9041 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:29.234629 9041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:29.238325 9041 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:29.240456 9071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:29.241616 9041 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:29.241726 9041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "8152a7df51ed47ee80057a28123cefd5"
format_stamp: "Formatted at 2026-08-10 01:44:46 on dist-test-slave-jlzn"
server_key: "a8e3f22f30eafbcbe49280fe0a92d0bc"
server_key_iv: "1525cb64fdb83f340da482591550757b"
server_key_version: "encryptionkey@0"
I20260810 01:45:29.242250 9041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:29.262445 9041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:29.264936 9041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:29.265100 9041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:29.271772 9041 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:35721
I20260810 01:45:29.272073 9146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:35721 every 8 connection(s)
I20260810 01:45:29.272807 9041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:29.276860 9147 sys_catalog.cc:263] Verifying existing consensus state
I20260810 01:45:29.278472 9147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Bootstrap starting.
I20260810 01:45:29.281185 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 9041
I20260810 01:45:29.281590 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:43333
--local_ip_for_outbound_sockets=127.16.58.65
--tserver_master_addrs=127.16.58.126:35721
--webserver_port=32815
--webserver_interface=127.16.58.65
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:45:29.295792 9147 log.cc:824] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:29.306931 9147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:45:29.307264 9147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Bootstrap complete.
I20260810 01:45:29.311055 9147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:45:29.311429 9147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8152a7df51ed47ee80057a28123cefd5, State: Initialized, Role: FOLLOWER
I20260810 01:45:29.311928 9147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:45:29.312067 9147 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:29.312134 9147 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:29.312233 9147 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 2 FOLLOWER]: Advancing to term 3
I20260810 01:45:29.314013 9147 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:45:29.314325 9147 leader_election.cc:302] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8152a7df51ed47ee80057a28123cefd5; no voters:
I20260810 01:45:29.314612 9147 leader_election.cc:288] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 01:45:29.314731 9155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 01:45:29.314941 9155 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [term 3 LEADER]: Becoming Leader. State: Replica: 8152a7df51ed47ee80057a28123cefd5, State: Running, Role: LEADER
I20260810 01:45:29.315289 9155 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } }
I20260810 01:45:29.315843 9147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:29.316725 9156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "8152a7df51ed47ee80057a28123cefd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } } }
I20260810 01:45:29.317085 9156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:29.316880 9158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8152a7df51ed47ee80057a28123cefd5. Latest consensus state: current_term: 3 leader_uuid: "8152a7df51ed47ee80057a28123cefd5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8152a7df51ed47ee80057a28123cefd5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35721 } } }
I20260810 01:45:29.317417 9158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:29.317461 9171 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:29.321630 9171 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:29.322147 9171 catalog_manager.cc:1259] Loaded cluster ID: ad4d235a58914559b70535647fa83b71
I20260810 01:45:29.322201 9171 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:29.323985 9171 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:29.324628 9171 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Loaded TSK: 0
I20260810 01:45:29.324695 9171 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8152a7df51ed47ee80057a28123cefd5: Loaded TSK: 1
F20260810 01:45:29.325249 9171 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe4cc46e9ad google::LogMessage::Fail() at ??:0
@ 0x7fe4cc47188a google::LogMessage::SendToLog() at ??:0
@ 0x7fe4cc46e4de google::LogMessage::Flush() at ??:0
@ 0x7fe4cc46fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe4cf13218d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fe4cf12af0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fe4d6dd77bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fe4d6db199c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fe4d6db2178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fe4d6df3df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fe4d6e1282b std::function<>::operator()() at ??:0
@ 0x7fe4d6db1b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fe4d6db2f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe4d6daf579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fe4d6df3640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe4ce6c03d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe4ce6c0c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fe4ce6c23f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe4ce6b1512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe4cfcf56db start_thread at ??:0
@ 0x7fe4caf6c61f clone at ??:0
W20260810 01:45:29.414291 9150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:29.414520 9150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:29.414600 9150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:29.418555 9150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:29.418608 9150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:29.418680 9150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:45:29.423624 9150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:43333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=32815
--tserver_master_addrs=127.16.58.126:35721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:29.424582 9150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:29.425511 9150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:29.434613 9227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:29.434821 9229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:29.434617 9226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:29.434998 9150 server_base.cc:1034] running on GCE node
I20260810 01:45:29.435350 9150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:29.435946 9150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:29.437103 9150 hybrid_clock.cc:648] HybridClock initialized: now 1786326329437071 us; error 48 us; skew 500 ppm
Aug 10 01:45:29 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326329, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:29.439607 9150 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:45:29.440398 9150 webserver.cc:460] Webserver started at http://127.16.58.65:32815/ using document root <none> and password file <none>
I20260810 01:45:29.440888 9150 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:29.440946 9150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:29.444571 9150 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:29.446633 9239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:29.447923 9150 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:29.448051 9150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "bcafe671eccb47b082fd8f87572e5a1d"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "ff6f70b38368c8959c407db107d7296a"
server_key_iv: "29f5837a7d34f1f7bf722952d8059ee2"
server_key_version: "encryptionkey@0"
I20260810 01:45:29.448537 9150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:29.460249 9150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:29.463449 9150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:29.463692 9150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:29.464382 9150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:29.465636 9248 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 01:45:29.469609 9150 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 01:45:29.469681 9150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260810 01:45:29.469753 9150 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 01:45:29.471900 9150 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 01:45:29.471959 9150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:29.472218 9248 tablet_bootstrap.cc:492] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Bootstrap starting.
I20260810 01:45:29.477928 9248 log.cc:824] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:29.485617 9248 tablet_bootstrap.cc:492] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 01:45:29.486097 9248 tablet_bootstrap.cc:492] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Bootstrap complete.
I20260810 01:45:29.486430 9248 ts_tablet_manager.cc:1397] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260810 01:45:29.487142 9150 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:43333
I20260810 01:45:29.487357 9420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:43333 every 8 connection(s)
I20260810 01:45:29.488150 9150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:45:29.488588 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 9150
I20260810 01:45:29.489077 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:42815
--local_ip_for_outbound_sockets=127.16.58.66
--tserver_master_addrs=127.16.58.126:35721
--webserver_port=34473
--webserver_interface=127.16.58.66
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:45:29.489871 9248 raft_consensus.cc:348] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:29.490355 9248 raft_consensus.cc:729] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcafe671eccb47b082fd8f87572e5a1d, State: Initialized, Role: FOLLOWER
I20260810 01:45:29.490804 9248 consensus_queue.cc:260] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:29.491711 9248 ts_tablet_manager.cc:1428] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
W20260810 01:45:29.569736 9430 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:45:29.490726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:42841)
0810 01:45:29.492134 (+ 1408us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:29.492172 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:29.492443 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:29.568999 (+ 76556us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1193,"thread_start_us":137,"threads_started":1}
W20260810 01:45:29.570326 9426 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:35721 (0 consecutive failures): Network error: Failed to ping master at 127.16.58.126:35721: Client connection negotiation failed: client connection to 127.16.58.126:35721: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 01:45:29.571096 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:29.570820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:50231)
0810 01:45:29.570953 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:29.571020 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 01:45:29.571789 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:29.571597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:36549)
0810 01:45:29.571690 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:29.571733 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 01:45:29.572005 9426 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 01:45:29.614104 9429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:29.614315 9429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:29.614352 9429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:29.618202 9429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:29.618249 9429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:29.618301 9429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:45:29.623137 9429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:42815
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=34473
--tserver_master_addrs=127.16.58.126:35721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:29.624017 9429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:29.624881 9429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:29.633652 9438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:29.633659 9437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:29.633661 9440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:29.633878 9429 server_base.cc:1034] running on GCE node
I20260810 01:45:29.634280 9429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:29.634888 9429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:29.636045 9429 hybrid_clock.cc:648] HybridClock initialized: now 1786326329636033 us; error 24 us; skew 500 ppm
Aug 10 01:45:29 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326329, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:29.638612 9429 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:45:29.639389 9429 webserver.cc:460] Webserver started at http://127.16.58.66:34473/ using document root <none> and password file <none>
I20260810 01:45:29.639932 9429 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:29.640003 9429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:29.643435 9429 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:29.645347 9453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:29.646458 9429 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:45:29.646595 9429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "0647b925294f0f078fce009da2ff013b"
server_key_iv: "7c9e3054478aedc88e319e45c0815490"
server_key_version: "encryptionkey@0"
I20260810 01:45:29.647068 9429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:29.664961 9429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:29.667538 9429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:29.667675 9429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:29.668172 9429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:29.668902 9429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:29.668948 9429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:29.668985 9429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:29.669005 9429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:29.677479 9429 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:42815
I20260810 01:45:29.677510 9621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:42815 every 8 connection(s)
I20260810 01:45:29.678366 9429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:45:29.681888 9625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:29.680276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:60061)
0810 01:45:29.680715 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:29.680813 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":102,"threads_started":1}
W20260810 01:45:29.682366 9623 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:35721 (0 consecutive failures): Network error: Failed to ping master at 127.16.58.126:35721: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
I20260810 01:45:29.682883 9625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:29.682687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:44373)
0810 01:45:29.682783 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:29.682829 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 01:45:29.683405 9625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:29.683254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:51683)
0810 01:45:29.683328 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:29.683365 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 01:45:29.683554 9623 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 01:45:29.687166 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 9429
I20260810 01:45:29.687554 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:38501
--local_ip_for_outbound_sockets=127.16.58.67
--tserver_master_addrs=127.16.58.126:35721
--webserver_port=34723
--webserver_interface=127.16.58.67
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:33971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:29.795472 9626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:29.795701 9626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:29.795756 9626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:29.799592 9626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:29.799643 9626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:29.799718 9626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:45:29.804679 9626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:33971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:38501
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=34723
--tserver_master_addrs=127.16.58.126:35721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9626
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:29.805583 9626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:29.806478 9626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:29.815397 9631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:29.815408 9635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:29.815408 9632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:29.815593 9626 server_base.cc:1034] running on GCE node
I20260810 01:45:29.816061 9626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:29.816622 9626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:29.817775 9626 hybrid_clock.cc:648] HybridClock initialized: now 1786326329817761 us; error 29 us; skew 500 ppm
Aug 10 01:45:29 dist-test-slave-jlzn krb5kdc[7400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326329, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:29.820315 9626 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:45:29.821043 9626 webserver.cc:460] Webserver started at http://127.16.58.67:34723/ using document root <none> and password file <none>
I20260810 01:45:29.821502 9626 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:29.821566 9626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:29.824998 9626 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:29.826848 9649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:29.827973 9626 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:29.828065 9626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "794969939b6048419449a02ce3dbbe8b"
format_stamp: "Formatted at 2026-08-10 01:44:47 on dist-test-slave-jlzn"
server_key: "2a91a512977c4e54b3db479d1b4e589a"
server_key_iv: "d8dedb9e647a6284e5857cf5aac8cdf5"
server_key_version: "encryptionkey@0"
I20260810 01:45:29.828521 9626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:29.839828 9626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:29.842541 9626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:29.842674 9626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:29.843137 9626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:29.843933 9626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:29.843981 9626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:29.844017 9626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:29.844038 9626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:29.852344 9626 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:38501
I20260810 01:45:29.852377 9829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:38501 every 8 connection(s)
I20260810 01:45:29.853288 9626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:45:29.853585 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 9626
I20260810 01:45:29.857183 9833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:29.855595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:51087)
0810 01:45:29.856029 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:29.856126 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":106,"threads_started":1}
W20260810 01:45:29.857573 9830 heartbeater.cc:644] Failed to heartbeat to 127.16.58.126:35721 (0 consecutive failures): Network error: Failed to ping master at 127.16.58.126:35721: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
I20260810 01:45:29.858104 9833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:29.857891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:41353)
0810 01:45:29.857991 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:29.858052 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 01:45:29.858620 9833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:29.858435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:60091)
0810 01:45:29.858528 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:29.858572 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 01:45:29.858771 9830 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 01:45:30.572948 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:30.572527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:35101)
0810 01:45:30.572770 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:30.572848 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":72,"threads_started":1}
I20260810 01:45:30.684401 9835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:30.684040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:39357)
0810 01:45:30.684251 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:30.684299 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":67,"threads_started":1}
I20260810 01:45:30.859591 9836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:30.859231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:55365)
0810 01:45:30.859447 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:30.859496 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":79,"threads_started":1}
I20260810 01:45:31.214028 9837 raft_consensus.cc:482] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:31.214239 9837 raft_consensus.cc:504] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:31.215240 9837 leader_election.cc:288] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815), 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
Aug 10 01:45:31 dist-test-slave-jlzn krb5kdc[7400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326329, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.66@KRBTEST.COM
Aug 10 01:45:31 dist-test-slave-jlzn krb5kdc[7400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326329, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.67@KRBTEST.COM
I20260810 01:45:31.228354 9838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:31.215414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:42815 (local address 127.16.58.65:55033)
0810 01:45:31.215677 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:31.215691 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:31.215848 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:31.217520 (+ 1672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:31.217526 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:31.218054 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:31.218549 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:31.218564 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:31.219838 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:31.219842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:31.220915 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:31.220925 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:31.221605 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:31.221608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:31.221802 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:31.222441 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:31.222453 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:31.223906 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:31.225976 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:31.225982 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:31.225994 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:31.226332 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:31.226656 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:31.226659 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:31.226661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:31.226823 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:31.227391 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:31.227397 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:31.227638 (+ 241us) client_negotiation.cc:769] Sending connection context
0810 01:45:31.227789 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 01:45:31.228124 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":169,"spinlock_wait_cycles":9216,"thread_start_us":54,"threads_started":1}
I20260810 01:45:31.228369 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:31.215956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:53059 (local address 127.16.58.67:38501)
0810 01:45:31.216211 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:31.216229 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:31.216260 (+ 31us) server_negotiation.cc:407] Connection header received
0810 01:45:31.216885 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:31.216890 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:31.217172 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:31.217440 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:31.218717 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:31.219679 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:31.221021 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:31.221471 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:31.221605 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:31.224470 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:31.224474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:31.224484 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:31.224508 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:31.225998 (+ 1490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:31.226447 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:31.226451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:31.226455 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:31.226565 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:31.226917 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:31.226919 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:31.226920 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:31.227279 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:31.227394 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:31.227973 (+ 579us) server_negotiation.cc:299] Negotiation successful
0810 01:45:31.228218 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":61,"threads_started":1}
I20260810 01:45:31.228392 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:31.215586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:55033 (local address 127.16.58.66:42815)
0810 01:45:31.216094 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:31.216110 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:31.216169 (+ 59us) server_negotiation.cc:407] Connection header received
0810 01:45:31.216837 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:31.216843 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:31.217176 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:31.217439 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:31.218711 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:31.219669 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:31.221034 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:31.221488 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:31.221639 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:31.224104 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:31.224110 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:31.224124 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:31.224156 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:31.225857 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:31.226447 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:31.226451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:31.226455 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:31.226565 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:31.226922 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:31.226925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:31.226926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:31.227278 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:31.227394 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:31.227968 (+ 574us) server_negotiation.cc:299] Negotiation successful
0810 01:45:31.228210 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":87,"threads_started":1}
I20260810 01:45:31.228408 9841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:31.215735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:38501 (local address 127.16.58.65:53059)
0810 01:45:31.216025 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:31.216039 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:31.216130 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:31.217521 (+ 1391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:31.217526 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:31.218054 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:31.218549 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:31.218563 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:31.219843 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:31.219847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:31.220912 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:31.220922 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:31.221588 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:31.221591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:31.221829 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:31.222393 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:31.222408 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:31.224311 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:31.226106 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:31.226108 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:31.226109 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:31.226339 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:31.226654 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:31.226657 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:31.226659 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:31.226817 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:31.227391 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:31.227397 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:31.227638 (+ 241us) client_negotiation.cc:769] Sending connection context
0810 01:45:31.227789 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 01:45:31.228211 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":315,"spinlock_wait_cycles":35584,"thread_start_us":78,"threads_started":1}
W20260810 01:45:31.231033 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
W20260810 01:45:31.231249 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
I20260810 01:45:31.231323 9243 leader_election.cc:302] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcafe671eccb47b082fd8f87572e5a1d; no voters: 659d0bc4d29740fe8c7bbd0b3ad15b84, 794969939b6048419449a02ce3dbbe8b
I20260810 01:45:31.231581 9837 raft_consensus.cc:2726] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:45:31.573886 9841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:31.573612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:46325)
0810 01:45:31.573743 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:31.573799 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 01:45:31.685391 9844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:31.685012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:54087)
0810 01:45:31.685244 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:31.685293 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":73,"threads_started":1}
I20260810 01:45:31.860523 9846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:31.860182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:42643)
0810 01:45:31.860392 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:31.860440 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":72,"threads_started":1}
I20260810 01:45:32.574971 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:32.574516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:36083)
0810 01:45:32.574805 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:32.574864 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":78,"threads_started":1}
I20260810 01:45:32.686435 9848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:32.686010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:36811)
0810 01:45:32.686245 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:32.686328 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":69,"threads_started":1}
I20260810 01:45:32.858649 9849 raft_consensus.cc:482] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:32.858775 9849 raft_consensus.cc:504] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:32.859150 9849 leader_election.cc:288] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815), 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
W20260810 01:45:32.860010 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
W20260810 01:45:32.860157 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
I20260810 01:45:32.860205 9243 leader_election.cc:302] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcafe671eccb47b082fd8f87572e5a1d; no voters: 659d0bc4d29740fe8c7bbd0b3ad15b84, 794969939b6048419449a02ce3dbbe8b
I20260810 01:45:32.860349 9849 raft_consensus.cc:2726] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:45:32.861471 9850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:32.861088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:33221)
0810 01:45:32.861315 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:32.861371 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":71,"threads_started":1}
I20260810 01:45:33.576093 9853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:33.575659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:40827)
0810 01:45:33.575931 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:33.575988 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":72,"threads_started":1}
I20260810 01:45:33.687480 9855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:33.687084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:35797)
0810 01:45:33.687316 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:33.687369 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":72,"threads_started":1}
I20260810 01:45:33.862452 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:33.862087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:48509)
0810 01:45:33.862315 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:33.862364 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":81,"threads_started":1}
I20260810 01:45:34.577280 9860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:34.576871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:57641)
0810 01:45:34.577128 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:34.577179 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":69,"threads_started":1}
I20260810 01:45:34.688582 9862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:34.688155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:53407)
0810 01:45:34.688409 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:34.688469 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":68,"threads_started":1}
I20260810 01:45:34.863569 9863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:34.863106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:48613)
0810 01:45:34.863393 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:34.863460 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":89,"threads_started":1}
I20260810 01:45:35.578397 9864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:35.577990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:46083)
0810 01:45:35.578241 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:35.578293 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":70,"threads_started":1}
I20260810 01:45:35.689594 9865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:35.689218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:56419)
0810 01:45:35.689450 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:35.689501 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":72,"threads_started":1}
I20260810 01:45:35.800933 9868 raft_consensus.cc:482] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:35.801080 9868 raft_consensus.cc:504] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:35.801476 9868 leader_election.cc:288] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815), 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
W20260810 01:45:35.802229 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
W20260810 01:45:35.802361 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
I20260810 01:45:35.802410 9243 leader_election.cc:302] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcafe671eccb47b082fd8f87572e5a1d; no voters: 659d0bc4d29740fe8c7bbd0b3ad15b84, 794969939b6048419449a02ce3dbbe8b
I20260810 01:45:35.802553 9868 raft_consensus.cc:2726] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:45:35.864691 9870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:35.864304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:41655)
0810 01:45:35.864538 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:35.864590 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":73,"threads_started":1}
I20260810 01:45:36.579455 9871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:36.579067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:41549)
0810 01:45:36.579305 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:36.579355 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":84,"threads_started":1}
I20260810 01:45:36.690613 9874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:36.690214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:34659)
0810 01:45:36.690466 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:36.690516 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":68,"threads_started":1}
I20260810 01:45:36.865903 9875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:36.865411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:54511)
0810 01:45:36.865733 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:36.865794 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":85,"threads_started":1}
I20260810 01:45:37.580551 9877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:37.580164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:56135)
0810 01:45:37.580402 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:37.580452 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":81,"threads_started":1}
I20260810 01:45:37.691686 9879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:37.691281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:40667)
0810 01:45:37.691529 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:37.691582 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":76,"threads_started":1}
I20260810 01:45:37.866940 9880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:37.866555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:40971)
0810 01:45:37.866791 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:37.866846 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":77,"threads_started":1}
I20260810 01:45:38.581598 9881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:38.581210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:45447)
0810 01:45:38.581437 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:38.581491 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":75,"threads_started":1}
I20260810 01:45:38.692724 9883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:38.692348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:52971)
0810 01:45:38.692571 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:38.692631 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":72,"threads_started":1}
I20260810 01:45:38.870747 9885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:38.870201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:32923)
0810 01:45:38.870586 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:38.870651 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":86,"threads_started":1}
I20260810 01:45:39.582770 9886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:39.582374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:50991)
0810 01:45:39.582608 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:39.582670 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":73,"threads_started":1}
I20260810 01:45:39.693746 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:39.693374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:44085)
0810 01:45:39.693604 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:39.693655 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":73,"threads_started":1}
I20260810 01:45:39.871858 9888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:39.871436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:45205)
0810 01:45:39.871681 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:39.871734 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":97,"threads_started":1}
I20260810 01:45:40.290747 9889 raft_consensus.cc:482] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:40.290896 9889 raft_consensus.cc:504] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:40.291313 9889 leader_election.cc:288] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815), 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
W20260810 01:45:40.292189 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
W20260810 01:45:40.292574 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
I20260810 01:45:40.292644 9243 leader_election.cc:302] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcafe671eccb47b082fd8f87572e5a1d; no voters: 659d0bc4d29740fe8c7bbd0b3ad15b84, 794969939b6048419449a02ce3dbbe8b
I20260810 01:45:40.292779 9889 raft_consensus.cc:2726] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:45:40.583896 9891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:40.583450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:49837)
0810 01:45:40.583702 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:40.583759 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":77,"threads_started":1}
I20260810 01:45:40.694697 9892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:40.694344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:38475)
0810 01:45:40.694561 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:40.694608 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":69,"threads_started":1}
I20260810 01:45:40.872861 9893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:40.872481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:47951)
0810 01:45:40.872721 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:40.872773 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":77,"threads_started":1}
I20260810 01:45:41.584973 9895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:41.584580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:41745)
0810 01:45:41.584818 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:41.584871 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
I20260810 01:45:41.695716 9898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:41.695328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:46075)
0810 01:45:41.695567 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:41.695620 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":72,"threads_started":1}
I20260810 01:45:41.873919 9899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:41.873544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:40365)
0810 01:45:41.873773 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:41.873825 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":70,"threads_started":1}
I20260810 01:45:42.586007 9900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:42.585616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:41693)
0810 01:45:42.585849 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:42.585906 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":73,"threads_started":1}
I20260810 01:45:42.696764 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:42.696372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:41217)
0810 01:45:42.696613 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:42.696672 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":73,"threads_started":1}
I20260810 01:45:42.874959 9902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:42.874562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:45817)
0810 01:45:42.874805 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:42.874857 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":88,"threads_started":1}
I20260810 01:45:43.408468 9903 raft_consensus.cc:482] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:43.408599 9903 raft_consensus.cc:504] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "659d0bc4d29740fe8c7bbd0b3ad15b84" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 42815 } } peers { permanent_uuid: "794969939b6048419449a02ce3dbbe8b" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38501 } } peers { permanent_uuid: "bcafe671eccb47b082fd8f87572e5a1d" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43333 } }
I20260810 01:45:43.408946 9903 leader_election.cc:288] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815), 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501)
W20260810 01:45:43.409704 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 659d0bc4d29740fe8c7bbd0b3ad15b84 (127.16.58.66:42815): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
W20260810 01:45:43.409839 9243 leader_election.cc:341] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 794969939b6048419449a02ce3dbbe8b (127.16.58.67:38501): Not found: Tablet not found: 63d5d87effea48128023ee352c9dec18
I20260810 01:45:43.409883 9243 leader_election.cc:302] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcafe671eccb47b082fd8f87572e5a1d; no voters: 659d0bc4d29740fe8c7bbd0b3ad15b84, 794969939b6048419449a02ce3dbbe8b
I20260810 01:45:43.410040 9903 raft_consensus.cc:2726] T 63d5d87effea48128023ee352c9dec18 P bcafe671eccb47b082fd8f87572e5a1d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 01:45:43.587152 9905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:43.586742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:33519)
0810 01:45:43.586982 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:43.587047 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":70,"threads_started":1}
I20260810 01:45:43.697742 9908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:43.697378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:60545)
0810 01:45:43.697599 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:43.697649 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":76,"threads_started":1}
I20260810 01:45:43.876022 9909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:43.875606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:45449)
0810 01:45:43.875868 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:43.875924 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":75,"threads_started":1}
I20260810 01:45:44.588498 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:44.588101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.65:51343)
0810 01:45:44.588348 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:44.588400 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":66,"threads_started":1}
I20260810 01:45:44.698939 9912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:44.698577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.66:33315)
0810 01:45:44.698802 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:44.698850 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":70,"threads_started":1}
I20260810 01:45:44.856257 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 9150
I20260810 01:45:44.873031 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 9429
I20260810 01:45:44.878574 9913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:44.877672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35721 (local address 127.16.58.67:48921)
0810 01:45:44.878420 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:44.878475 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.126:35721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":558,"threads_started":1}
I20260810 01:45:44.883287 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 9626
2026-08-10T01:45:44Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59445 ms)
[----------] 30 tests from SecurityITest (234701 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:45:44 dist-test-slave-jlzn krb5kdc[9918](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:45:44 dist-test-slave-jlzn krb5kdc[9918](info): set up 2 sockets
Aug 10 01:45:44 dist-test-slave-jlzn krb5kdc[9918](info): commencing operation
krb5kdc: starting...
W20260810 01:45:46.013732 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:45:46 dist-test-slave-jlzn krb5kdc[9918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:45:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:45:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:45:46.127674 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:40099
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:40099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:46.236857 9940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:46.237093 9940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:46.237138 9940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:46.241004 9940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:46.241047 9940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:46.241065 9940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:46.241086 9940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:46.241106 9940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:46.246094 9940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:40099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:40099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:46.246971 9940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:46.247874 9940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:46.256047 9948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:46.256098 9946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:46.256093 9951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:46.256184 9940 server_base.cc:1034] running on GCE node
I20260810 01:45:46.256935 9940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:46.257934 9940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:46.259090 9940 hybrid_clock.cc:648] HybridClock initialized: now 1786326346259079 us; error 30 us; skew 500 ppm
Aug 10 01:45:46 dist-test-slave-jlzn krb5kdc[9918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326346, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:46.261703 9940 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:45:46.262560 9940 webserver.cc:460] Webserver started at http://127.16.58.126:34675/ using document root <none> and password file <none>
I20260810 01:45:46.263078 9940 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:46.263139 9940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:46.263338 9940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:46.265337 9940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "d66e822ef0094656b3e6f8b72fde9fcf"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "9c57f10e5e141e82f56470607ee7cdb4"
server_key_iv: "4464c6d7dc12a860c1c534b7d6bb60d2"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.265954 9940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "d66e822ef0094656b3e6f8b72fde9fcf"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "9c57f10e5e141e82f56470607ee7cdb4"
server_key_iv: "4464c6d7dc12a860c1c534b7d6bb60d2"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.269454 9940 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260810 01:45:46.271648 9962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:46.272814 9940 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:45:46.272938 9940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "d66e822ef0094656b3e6f8b72fde9fcf"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "9c57f10e5e141e82f56470607ee7cdb4"
server_key_iv: "4464c6d7dc12a860c1c534b7d6bb60d2"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.273028 9940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:46.302788 9940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:46.305406 9940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:46.305568 9940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:46.312052 9940 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:40099
I20260810 01:45:46.312075 10049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:40099 every 8 connection(s)
I20260810 01:45:46.312922 9940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:46.313253 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 9940
I20260810 01:45:46.313372 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:45:46.313664 16617 external_mini_cluster.cc:1428] Setting key b67ddb24743e34a8df4e5a4a54cde79e
I20260810 01:45:46.315855 10050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:46.321071 10050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf: Bootstrap starting.
Aug 10 01:45:46 dist-test-slave-jlzn krb5kdc[9918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:46.323439 10050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:46.324216 10050 log.cc:824] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:46.326205 10050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf: No bootstrap required, opened a new log
I20260810 01:45:46.327239 10058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:46.314990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56850 (local address 127.16.58.126:40099)
0810 01:45:46.315434 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:46.315449 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:46.315483 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:45:46.316208 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:46.316226 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:46.316530 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:46.316819 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:46.317608 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.318600 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.319451 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.319974 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.320132 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:46.322728 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:46.322733 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:46.322745 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:46.322771 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:46.324573 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:46.325083 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:46.325089 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:46.325095 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:46.325211 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:46.325476 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:46.325479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:46.325481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:46.325852 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:46.326031 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:46.326322 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 01:45:46.326584 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":154,"threads_started":1}
I20260810 01:45:46.330010 10050 raft_consensus.cc:348] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66e822ef0094656b3e6f8b72fde9fcf" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40099 } }
I20260810 01:45:46.330231 10050 raft_consensus.cc:374] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:46.330310 10050 raft_consensus.cc:729] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d66e822ef0094656b3e6f8b72fde9fcf, State: Initialized, Role: FOLLOWER
I20260810 01:45:46.330708 10050 consensus_queue.cc:260] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66e822ef0094656b3e6f8b72fde9fcf" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40099 } }
I20260810 01:45:46.330849 10050 raft_consensus.cc:388] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:46.330912 10050 raft_consensus.cc:482] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:46.331008 10050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:46.331948 10050 raft_consensus.cc:504] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66e822ef0094656b3e6f8b72fde9fcf" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40099 } }
I20260810 01:45:46.332309 10050 leader_election.cc:302] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d66e822ef0094656b3e6f8b72fde9fcf; no voters:
I20260810 01:45:46.332619 10050 leader_election.cc:288] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:45:46.332719 10061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:46.332942 10061 raft_consensus.cc:686] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [term 1 LEADER]: Becoming Leader. State: Replica: d66e822ef0094656b3e6f8b72fde9fcf, State: Running, Role: LEADER
I20260810 01:45:46.333251 10061 consensus_queue.cc:237] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66e822ef0094656b3e6f8b72fde9fcf" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40099 } }
I20260810 01:45:46.333705 10050 sys_catalog.cc:564] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:46.334759 10062 sys_catalog.cc:455] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d66e822ef0094656b3e6f8b72fde9fcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66e822ef0094656b3e6f8b72fde9fcf" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40099 } } }
I20260810 01:45:46.334897 10062 sys_catalog.cc:458] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:46.335295 10081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:46.335610 10063 sys_catalog.cc:455] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader d66e822ef0094656b3e6f8b72fde9fcf. Latest consensus state: current_term: 1 leader_uuid: "d66e822ef0094656b3e6f8b72fde9fcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d66e822ef0094656b3e6f8b72fde9fcf" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40099 } } }
I20260810 01:45:46.335712 10063 sys_catalog.cc:458] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:46.338220 10081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:46.343642 10081 catalog_manager.cc:1347] Generated new cluster ID: f45d2d1024b44b3f9c3ad9364cea242d
I20260810 01:45:46.343761 10081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:46.365661 10081 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:45:46.366519 10081 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:46.373659 10081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf: Generated new TSK 0
I20260810 01:45:46.374260 10081 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:45:46.406633 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40099
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:46.514582 10099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:46.514811 10099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:46.514853 10099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:46.518733 10099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:46.518782 10099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:46.518849 10099 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:45:46.523833 10099 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:46.524791 10099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:46.525872 10099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:46.534955 10106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:46.535117 10099 server_base.cc:1034] running on GCE node
W20260810 01:45:46.534978 10108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:46.534958 10105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:46.535662 10099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:46.536275 10099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:46.537426 10099 hybrid_clock.cc:648] HybridClock initialized: now 1786326346537396 us; error 36 us; skew 500 ppm
Aug 10 01:45:46 dist-test-slave-jlzn krb5kdc[9918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326346, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:46.540012 10099 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:45:46.540812 10099 webserver.cc:460] Webserver started at http://127.16.58.65:36435/ using document root <none> and password file <none>
I20260810 01:45:46.541318 10099 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:46.541414 10099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:46.541600 10099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:46.543514 10099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "f5d57886266748908f3d9a36357dffee"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "bd546afce4e6966fd59a56731762afae"
server_key_iv: "84490a5cabca57f8438a8851cf6cb4bf"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.544075 10099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "f5d57886266748908f3d9a36357dffee"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "bd546afce4e6966fd59a56731762afae"
server_key_iv: "84490a5cabca57f8438a8851cf6cb4bf"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.547465 10099 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:45:46.549721 10125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:46.550871 10099 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:46.550992 10099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "f5d57886266748908f3d9a36357dffee"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "bd546afce4e6966fd59a56731762afae"
server_key_iv: "84490a5cabca57f8438a8851cf6cb4bf"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.551115 10099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:46.573802 10099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:46.576669 10099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:46.576838 10099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:46.577448 10099 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:46.578311 10099 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:46.578361 10099 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:46.578408 10099 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:46.578435 10099 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:46.586684 10099 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:42711
I20260810 01:45:46.586746 10290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:42711 every 8 connection(s)
I20260810 01:45:46.587673 10099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:45:46.592226 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 10099
I20260810 01:45:46.592357 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:45:46.592671 16617 external_mini_cluster.cc:1428] Setting key 977e40d6ceccbc45ffb07c593d488584
Aug 10 01:45:46 dist-test-slave-jlzn krb5kdc[9918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326346, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:46.600867 10058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:46.589347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:47979 (local address 127.16.58.126:40099)
0810 01:45:46.589463 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:46.589467 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:46.590407 (+ 940us) server_negotiation.cc:407] Connection header received
0810 01:45:46.591199 (+ 792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:46.591201 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:46.591249 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:46.591316 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:46.592583 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.593236 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.594595 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.594832 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.594911 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:46.597555 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:46.597558 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:46.597560 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:46.597583 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:46.598859 (+ 1276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:46.599403 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:46.599405 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:46.599407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:46.599476 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:46.599863 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:46.599865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:46.599866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:46.600027 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:46.600102 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:46.600653 (+ 551us) server_negotiation.cc:299] Negotiation successful
0810 01:45:46.600750 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:45:46.601903 10293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:46.589665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40099 (local address 127.16.58.65:47979)
0810 01:45:46.590271 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:46.590309 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:46.591037 (+ 728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:46.591441 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:46.591446 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:46.591795 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:46.592430 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:46.592451 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.593356 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.593360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:46.594476 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:46.594489 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.594972 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.594976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:46.595162 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:46.595688 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:46.595706 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:46.597399 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:46.598966 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:46.598972 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:46.598986 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:46.599320 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:46.599555 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:46.599558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:46.599561 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:46.599741 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:46.600123 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:46.600129 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:46.600427 (+ 298us) client_negotiation.cc:769] Sending connection context
0810 01:45:46.600626 (+ 199us) client_negotiation.cc:240] Negotiation successful
0810 01:45:46.600938 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":110,"threads_started":1}
I20260810 01:45:46.602999 10291 heartbeater.cc:347] Connected to a master server at 127.16.58.126:40099
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:45:46.603248 10291 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:46.603709 10291 heartbeater.cc:511] Master 127.16.58.126:40099 requested a full tablet report, sending...
I20260810 01:45:46.605212 9987 ts_manager.cc:194] Registered new tserver with Master: f5d57886266748908f3d9a36357dffee (127.16.58.65:42711)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
I20260810 01:45:46.606441 9987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:47979
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:45:46.618353 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40099
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:46.725800 10297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:46.726027 10297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:46.726069 10297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:46.729979 10297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:46.730033 10297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:46.730121 10297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:45:46.735239 10297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:46.736213 10297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:46.737145 10297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:46.746263 10302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:46.746310 10304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:46.746433 10297 server_base.cc:1034] running on GCE node
W20260810 01:45:46.746310 10306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:46.746929 10297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:46.747511 10297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:46.748670 10297 hybrid_clock.cc:648] HybridClock initialized: now 1786326346748655 us; error 26 us; skew 500 ppm
Aug 10 01:45:46 dist-test-slave-jlzn krb5kdc[9918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326346, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:46.751324 10297 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:45:46.752198 10297 webserver.cc:460] Webserver started at http://127.16.58.66:33147/ using document root <none> and password file <none>
I20260810 01:45:46.752696 10297 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:46.752753 10297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:46.752918 10297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:46.754886 10297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "aa5962a1ca5f4adeb322c2070b1b58e7"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "846caf63ed19f528ec56dd2807fae52d"
server_key_iv: "77e2d10f693126edbb6ec549dc195ea0"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.755391 10297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "aa5962a1ca5f4adeb322c2070b1b58e7"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "846caf63ed19f528ec56dd2807fae52d"
server_key_iv: "77e2d10f693126edbb6ec549dc195ea0"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.758826 10297 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:45:46.761066 10317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:46.762171 10297 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:45:46.762270 10297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "aa5962a1ca5f4adeb322c2070b1b58e7"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "846caf63ed19f528ec56dd2807fae52d"
server_key_iv: "77e2d10f693126edbb6ec549dc195ea0"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.762362 10297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:46.771389 10297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:46.774246 10297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:46.774405 10297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:46.774920 10297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:46.775844 10297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:46.775900 10297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:46.775957 10297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:46.775990 10297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:46.784363 10297 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:35165
I20260810 01:45:46.784385 10474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:35165 every 8 connection(s)
I20260810 01:45:46.785159 10297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
Aug 10 01:45:46 dist-test-slave-jlzn krb5kdc[9918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326346, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:46.793510 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 10297
I20260810 01:45:46.793655 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:45:46.793946 16617 external_mini_cluster.cc:1428] Setting key ae468549c733df02c67cf7022dd0cf07
I20260810 01:45:46.797276 10058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:46.786742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:60305 (local address 127.16.58.126:40099)
0810 01:45:46.786862 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:46.786866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:46.787843 (+ 977us) server_negotiation.cc:407] Connection header received
0810 01:45:46.788629 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:46.788632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:46.788676 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:46.788745 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:46.789758 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.790264 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.791278 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.791481 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.791569 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:46.793757 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:46.793762 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:46.793764 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:46.793790 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:46.795290 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:46.795883 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:46.795885 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:46.795887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:46.795965 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:46.796324 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:46.796326 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:46.796328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:46.796498 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:46.796580 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:46.797068 (+ 488us) server_negotiation.cc:299] Negotiation successful
0810 01:45:46.797156 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:45:46.798094 10480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:46.787088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40099 (local address 127.16.58.66:60305)
0810 01:45:46.787690 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:46.787727 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:46.788469 (+ 742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:46.788878 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:46.788884 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:46.789210 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:46.789641 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:46.789654 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.790346 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.790348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:46.791192 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:46.791201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:46.791589 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:46.791592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:46.791717 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:46.792196 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:46.792212 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:46.793591 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:46.795416 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:46.795422 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:46.795434 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:46.795753 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:46.796047 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:46.796050 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:46.796052 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:46.796226 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:46.796585 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:46.796591 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:46.796857 (+ 266us) client_negotiation.cc:769] Sending connection context
0810 01:45:46.797030 (+ 173us) client_negotiation.cc:240] Negotiation successful
0810 01:45:46.797327 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":114,"threads_started":1}
I20260810 01:45:46.799103 10478 heartbeater.cc:347] Connected to a master server at 127.16.58.126:40099
I20260810 01:45:46.799304 10478 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:46.799723 10478 heartbeater.cc:511] Master 127.16.58.126:40099 requested a full tablet report, sending...
I20260810 01:45:46.800685 9987 ts_manager.cc:194] Registered new tserver with Master: aa5962a1ca5f4adeb322c2070b1b58e7 (127.16.58.66:35165)
I20260810 01:45:46.801224 9987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:60305
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:45:46.820497 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40099
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:46.933622 10486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:46.933861 10486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:46.933917 10486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:46.937945 10486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:46.937999 10486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:46.938073 10486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:45:46.943099 10486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:46.944074 10486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:46.945005 10486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:46.954101 10499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:46.954175 10486 server_base.cc:1034] running on GCE node
W20260810 01:45:46.954130 10500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:46.954108 10502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:46.954775 10486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:46.955382 10486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:46.956566 10486 hybrid_clock.cc:648] HybridClock initialized: now 1786326346956548 us; error 28 us; skew 500 ppm
Aug 10 01:45:46 dist-test-slave-jlzn krb5kdc[9918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326346, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:46.959066 10486 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:45:46.959954 10486 webserver.cc:460] Webserver started at http://127.16.58.67:33545/ using document root <none> and password file <none>
I20260810 01:45:46.960470 10486 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:46.960548 10486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:46.960747 10486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:46.962684 10486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "50a2c886b20047da8f928ecb7bf23dbc"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "5ff3d333bd096827c1eac23414e600c6"
server_key_iv: "2172719f7a03bfd5190c9cb7b7faabc5"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.963346 10486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "50a2c886b20047da8f928ecb7bf23dbc"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "5ff3d333bd096827c1eac23414e600c6"
server_key_iv: "2172719f7a03bfd5190c9cb7b7faabc5"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.967020 10486 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:45:46.969285 10517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:46.970362 10486 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:45:46.970469 10486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "50a2c886b20047da8f928ecb7bf23dbc"
format_stamp: "Formatted at 2026-08-10 01:45:46 on dist-test-slave-jlzn"
server_key: "5ff3d333bd096827c1eac23414e600c6"
server_key_iv: "2172719f7a03bfd5190c9cb7b7faabc5"
server_key_version: "encryptionkey@0"
I20260810 01:45:46.970558 10486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:46.988253 10486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:46.990677 10486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:46.990818 10486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:46.991300 10486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:46.992106 10486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:46.992156 10486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:46.992193 10486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:46.992214 10486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:47.000449 10486 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:46679
I20260810 01:45:47.000479 10685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:46679 every 8 connection(s)
I20260810 01:45:47.001227 10486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:45:47.007071 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 10486
I20260810 01:45:47.007179 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:45:47.007440 16617 external_mini_cluster.cc:1428] Setting key 75d9f9199723420debc0e81e3ecc2aec
Aug 10 01:45:47 dist-test-slave-jlzn krb5kdc[9918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326346, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:47.013597 10058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.002836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:50407 (local address 127.16.58.126:40099)
0810 01:45:47.002957 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.002962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.003921 (+ 959us) server_negotiation.cc:407] Connection header received
0810 01:45:47.004764 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.004767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.004825 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.004897 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:47.005969 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.006493 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.007675 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.007958 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.008063 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.010612 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:47.010615 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:47.010617 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:47.010644 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:47.011996 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:47.012439 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:47.012441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:47.012443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:47.012513 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:47.012755 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:47.012756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:47.012757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:47.012911 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:47.012979 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.013392 (+ 413us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.013482 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:45:47.014346 10688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.003171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40099 (local address 127.16.58.67:50407)
0810 01:45:47.003769 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:47.003835 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:47.004553 (+ 718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:47.005063 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:47.005069 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:47.005388 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:47.005828 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.005840 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.006612 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.006615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.007562 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.007572 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.008119 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.008123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.008326 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.008910 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:47.008929 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:47.010462 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:47.012106 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:47.012111 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:47.012122 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:47.012361 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:47.012573 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:47.012575 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:47.012576 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:47.012692 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:47.012997 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:47.013003 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:47.013216 (+ 213us) client_negotiation.cc:769] Sending connection context
0810 01:45:47.013360 (+ 144us) client_negotiation.cc:240] Negotiation successful
0810 01:45:47.013596 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":101,"threads_started":1}
I20260810 01:45:47.015281 10686 heartbeater.cc:347] Connected to a master server at 127.16.58.126:40099
I20260810 01:45:47.015494 10686 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:47.015972 10686 heartbeater.cc:511] Master 127.16.58.126:40099 requested a full tablet report, sending...
I20260810 01:45:47.016898 9987 ts_manager.cc:194] Registered new tserver with Master: 50a2c886b20047da8f928ecb7bf23dbc (127.16.58.67:46679)
I20260810 01:45:47.017432 9987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:50407
I20260810 01:45:47.021032 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:45:47.029265 10058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.022858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56866 (local address 127.16.58.126:40099)
0810 01:45:47.022982 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.022987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.023154 (+ 167us) server_negotiation.cc:407] Connection header received
0810 01:45:47.023252 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.023255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.023294 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.023356 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:47.024030 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.024515 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.025323 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.025532 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.025613 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.026748 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:47.026752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:47.026753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:47.026775 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:47.027765 (+ 990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:47.028160 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:47.028163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:47.028164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:47.028236 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:47.028472 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:47.028475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:47.028477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:47.028675 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:47.028796 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.029014 (+ 218us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.029116 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:45:47.031746 9987 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:45:47.034813 9987 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:45:47.048100 10705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.042396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:46679 (local address 127.0.0.1:52412)
0810 01:45:47.043329 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:47.043342 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:47.043493 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:47.044159 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:47.044161 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:47.044176 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:47.044268 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.044277 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.045302 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.045305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.046626 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.046638 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.047551 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.047555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.047671 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.047712 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 01:45:47.047841 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 01:45:47.047959 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":870,"mutex_wait_us":59,"thread_start_us":84,"threads_started":1}
I20260810 01:45:47.048110 10706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.042753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52412 (local address 127.16.58.67:46679)
0810 01:45:47.043181 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.043192 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.043423 (+ 231us) server_negotiation.cc:407] Connection header received
0810 01:45:47.043650 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.043655 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.043861 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.043993 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:47.044379 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.045188 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.046747 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.047438 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.047534 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.047676 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.047875 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.047967 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":146,"threads_started":1}
I20260810 01:45:47.048318 10704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.042273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:35165 (local address 127.0.0.1:60378)
0810 01:45:47.042577 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:47.042620 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:47.042735 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:47.043897 (+ 1162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:47.043903 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:47.043928 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:47.044058 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.044065 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.045662 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.045665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.046852 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.046859 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.047936 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.047940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.048034 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.048056 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:45:47.048103 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 01:45:47.048183 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":78,"thread_start_us":75,"threads_started":1}
I20260810 01:45:47.048528 10708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.042944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42711 (local address 127.0.0.1:60482)
0810 01:45:47.043895 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:47.043908 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:47.043997 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:47.044434 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:47.044437 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:47.044455 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:47.044541 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.044547 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.045816 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.045820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.046963 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.046974 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.048175 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.048178 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.048265 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.048285 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:45:47.048354 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:45:47.048417 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":892,"mutex_wait_us":4,"thread_start_us":100,"threads_started":1}
I20260810 01:45:47.048635 10714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.043271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60482 (local address 127.16.58.65:42711)
0810 01:45:47.043667 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.043677 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.043983 (+ 306us) server_negotiation.cc:407] Connection header received
0810 01:45:47.044113 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.044118 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.044301 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.044441 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:47.044633 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.045700 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.047083 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.047891 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.047981 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.048116 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.048409 (+ 293us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.048502 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":118,"threads_started":1}
I20260810 01:45:47.049427 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.042936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60378 (local address 127.16.58.66:35165)
0810 01:45:47.043351 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.043363 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.043388 (+ 25us) server_negotiation.cc:407] Connection header received
0810 01:45:47.043469 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.043474 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.043687 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.044204 (+ 517us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:47.044374 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.045524 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.046953 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.047760 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.048416 (+ 656us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.049154 (+ 738us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.049204 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.049288 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":141,"threads_started":1}
I20260810 01:45:47.051594 10389 tablet_service.cc:1467] Processing CreateTablet for tablet 351b749e3dce41168156e3dcad5ab519 (DEFAULT_TABLE table=test-table [id=a28e95fd9a514734b2307a963417e0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:47.051626 10591 tablet_service.cc:1467] Processing CreateTablet for tablet 351b749e3dce41168156e3dcad5ab519 (DEFAULT_TABLE table=test-table [id=a28e95fd9a514734b2307a963417e0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:47.051626 10196 tablet_service.cc:1467] Processing CreateTablet for tablet 351b749e3dce41168156e3dcad5ab519 (DEFAULT_TABLE table=test-table [id=a28e95fd9a514734b2307a963417e0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:47.052664 10389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351b749e3dce41168156e3dcad5ab519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:47.052677 10196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351b749e3dce41168156e3dcad5ab519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:47.052682 10591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 351b749e3dce41168156e3dcad5ab519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:47.058630 10719 tablet_bootstrap.cc:492] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: Bootstrap starting.
I20260810 01:45:47.060249 10721 tablet_bootstrap.cc:492] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee: Bootstrap starting.
I20260810 01:45:47.061457 10719 tablet_bootstrap.cc:654] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:47.062079 10721 tablet_bootstrap.cc:654] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:47.062184 10719 log.cc:824] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:47.062803 10722 tablet_bootstrap.cc:492] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: Bootstrap starting.
I20260810 01:45:47.063206 10721 log.cc:824] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:47.064576 10722 tablet_bootstrap.cc:654] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:47.065023 10721 tablet_bootstrap.cc:492] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee: No bootstrap required, opened a new log
I20260810 01:45:47.065208 10721 ts_tablet_manager.cc:1397] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:45:47.065598 10722 log.cc:824] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:47.067075 10719 tablet_bootstrap.cc:492] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: No bootstrap required, opened a new log
I20260810 01:45:47.067258 10719 ts_tablet_manager.cc:1397] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.004s
I20260810 01:45:47.068198 10721 raft_consensus.cc:348] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } }
I20260810 01:45:47.068406 10721 raft_consensus.cc:374] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:47.068454 10721 raft_consensus.cc:729] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d57886266748908f3d9a36357dffee, State: Initialized, Role: FOLLOWER
I20260810 01:45:47.068850 10721 consensus_queue.cc:260] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } }
I20260810 01:45:47.069482 10291 heartbeater.cc:503] Master 127.16.58.126:40099 was elected leader, sending a full tablet report...
I20260810 01:45:47.069723 10721 ts_tablet_manager.cc:1428] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260810 01:45:47.070274 10719 raft_consensus.cc:348] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } }
I20260810 01:45:47.070520 10719 raft_consensus.cc:374] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:47.070588 10719 raft_consensus.cc:729] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa5962a1ca5f4adeb322c2070b1b58e7, State: Initialized, Role: FOLLOWER
I20260810 01:45:47.070942 10719 consensus_queue.cc:260] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } }
I20260810 01:45:47.071575 10478 heartbeater.cc:503] Master 127.16.58.126:40099 was elected leader, sending a full tablet report...
I20260810 01:45:47.071702 10719 ts_tablet_manager.cc:1428] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 01:45:47.073021 10722 tablet_bootstrap.cc:492] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: No bootstrap required, opened a new log
I20260810 01:45:47.073252 10722 ts_tablet_manager.cc:1397] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260810 01:45:47.076400 10722 raft_consensus.cc:348] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } }
I20260810 01:45:47.076596 10722 raft_consensus.cc:374] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:47.076654 10722 raft_consensus.cc:729] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50a2c886b20047da8f928ecb7bf23dbc, State: Initialized, Role: FOLLOWER
I20260810 01:45:47.076990 10722 consensus_queue.cc:260] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } }
I20260810 01:45:47.077556 10686 heartbeater.cc:503] Master 127.16.58.126:40099 was elected leader, sending a full tablet report...
I20260810 01:45:47.077704 10722 ts_tablet_manager.cc:1428] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
W20260810 01:45:47.088722 10292 tablet.cc:2369] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:45:47.132310 10735 raft_consensus.cc:482] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:47.132498 10735 raft_consensus.cc:504] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } }
I20260810 01:45:47.133596 10735 leader_election.cc:288] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa5962a1ca5f4adeb322c2070b1b58e7 (127.16.58.66:35165), f5d57886266748908f3d9a36357dffee (127.16.58.65:42711)
I20260810 01:45:47.137461 10688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.133793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:35165 (local address 127.16.58.67:41867)
0810 01:45:47.133929 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:47.133944 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:47.134030 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:47.134359 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:47.134363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:47.134382 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:47.134505 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.134512 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.135343 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.135347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.136315 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.136326 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.137058 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.137062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.137183 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.137209 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:45:47.137277 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 01:45:47.137346 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 01:45:47.137490 10709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.133883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:41867 (local address 127.16.58.66:35165)
0810 01:45:47.133998 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.134001 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.134017 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:45:47.134194 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.134198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.134257 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.134337 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:47.134635 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.135244 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.136437 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.136955 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.137046 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.137089 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.137293 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.137363 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:45:47.137682 10737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.134062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42711 (local address 127.16.58.67:38295)
0810 01:45:47.134384 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:47.134395 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:47.134495 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:47.134745 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:47.134747 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:47.134764 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:47.134861 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.134866 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.135691 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.135695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.136611 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.136624 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.137291 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.137295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.137395 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.137419 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:45:47.137492 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 01:45:47.137554 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":126,"threads_started":1}
I20260810 01:45:47.137720 10714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.134202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:38295 (local address 127.16.58.65:42711)
0810 01:45:47.134320 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.134324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.134485 (+ 161us) server_negotiation.cc:407] Connection header received
0810 01:45:47.134589 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.134593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.134650 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.134729 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:47.134992 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.135575 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.136740 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.137178 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.137295 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.137342 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.137523 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.137596 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:45:47.138399 10223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351b749e3dce41168156e3dcad5ab519" candidate_uuid: "50a2c886b20047da8f928ecb7bf23dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d57886266748908f3d9a36357dffee" is_pre_election: true
I20260810 01:45:47.138401 10419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351b749e3dce41168156e3dcad5ab519" candidate_uuid: "50a2c886b20047da8f928ecb7bf23dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" is_pre_election: true
I20260810 01:45:47.138700 10223 raft_consensus.cc:2454] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50a2c886b20047da8f928ecb7bf23dbc in term 0.
I20260810 01:45:47.138700 10419 raft_consensus.cc:2454] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50a2c886b20047da8f928ecb7bf23dbc in term 0.
I20260810 01:45:47.139142 10519 leader_election.cc:302] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a2c886b20047da8f928ecb7bf23dbc, aa5962a1ca5f4adeb322c2070b1b58e7; no voters:
I20260810 01:45:47.139389 10735 raft_consensus.cc:2781] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:45:47.139467 10735 raft_consensus.cc:482] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:45:47.139518 10735 raft_consensus.cc:3037] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:47.140553 10735 raft_consensus.cc:504] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } }
I20260810 01:45:47.140851 10735 leader_election.cc:288] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [CANDIDATE]: Term 1 election: Requested vote from peers aa5962a1ca5f4adeb322c2070b1b58e7 (127.16.58.66:35165), f5d57886266748908f3d9a36357dffee (127.16.58.65:42711)
I20260810 01:45:47.141184 10419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351b749e3dce41168156e3dcad5ab519" candidate_uuid: "50a2c886b20047da8f928ecb7bf23dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7"
I20260810 01:45:47.141219 10223 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "351b749e3dce41168156e3dcad5ab519" candidate_uuid: "50a2c886b20047da8f928ecb7bf23dbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d57886266748908f3d9a36357dffee"
I20260810 01:45:47.141294 10419 raft_consensus.cc:3037] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:47.141319 10223 raft_consensus.cc:3037] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:47.142280 10419 raft_consensus.cc:2454] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a2c886b20047da8f928ecb7bf23dbc in term 1.
I20260810 01:45:47.142340 10223 raft_consensus.cc:2454] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50a2c886b20047da8f928ecb7bf23dbc in term 1.
I20260810 01:45:47.142560 10519 leader_election.cc:302] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50a2c886b20047da8f928ecb7bf23dbc, aa5962a1ca5f4adeb322c2070b1b58e7; no voters:
I20260810 01:45:47.142719 10735 raft_consensus.cc:2781] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:47.142930 10735 raft_consensus.cc:686] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 1 LEADER]: Becoming Leader. State: Replica: 50a2c886b20047da8f928ecb7bf23dbc, State: Running, Role: LEADER
I20260810 01:45:47.143270 10735 consensus_queue.cc:237] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } }
I20260810 01:45:47.146212 9987 catalog_manager.cc:5495] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 50a2c886b20047da8f928ecb7bf23dbc (127.16.58.67). New cstate: current_term: 1 leader_uuid: "50a2c886b20047da8f928ecb7bf23dbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50a2c886b20047da8f928ecb7bf23dbc" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 46679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260810 01:45:47.170825 10706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.166551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52416 (local address 127.16.58.67:46679)
0810 01:45:47.166689 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.166694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.166707 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:45:47.166837 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.166840 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.166895 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.166982 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:45:47.167219 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.167935 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.169093 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.169429 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.169531 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.169838 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:45:47.170345 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:45:47.170452 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.170599 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.170660 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:45:47.176528 10419 raft_consensus.cc:1261] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [term 1 FOLLOWER]: Refusing update from remote peer 50a2c886b20047da8f928ecb7bf23dbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:47.176568 10223 raft_consensus.cc:1261] T 351b749e3dce41168156e3dcad5ab519 P f5d57886266748908f3d9a36357dffee [term 1 FOLLOWER]: Refusing update from remote peer 50a2c886b20047da8f928ecb7bf23dbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:47.177223 10739 consensus_queue.cc:1035] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa5962a1ca5f4adeb322c2070b1b58e7" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 35165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:47.177459 10735 consensus_queue.cc:1035] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d57886266748908f3d9a36357dffee" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:47.186797 10745 mvcc.cc:205] Tried to move back new op lower bound from 7316792718028271616 to 7316792717901406208. Current Snapshot: MvccSnapshot[applied={T|T < 7316792718028271616 or (T in {7316792718028271616})}]
I20260810 01:45:47.187028 10746 mvcc.cc:205] Tried to move back new op lower bound from 7316792718028271616 to 7316792717901406208. Current Snapshot: MvccSnapshot[applied={T|T < 7316792718028271616}]
I20260810 01:45:47.192859 9987 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:47.193030 9987 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:47.195346 9987 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d66e822ef0094656b3e6f8b72fde9fcf: Sending DeleteTablet for 3 replicas of tablet 351b749e3dce41168156e3dcad5ab519
I20260810 01:45:47.196070 10389 tablet_service.cc:1514] Processing DeleteTablet for tablet 351b749e3dce41168156e3dcad5ab519 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:47 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:60378
I20260810 01:45:47.196251 10196 tablet_service.cc:1514] Processing DeleteTablet for tablet 351b749e3dce41168156e3dcad5ab519 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:47 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:60482
I20260810 01:45:47.196249 10591 tablet_service.cc:1514] Processing DeleteTablet for tablet 351b749e3dce41168156e3dcad5ab519 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:47 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:52412
I20260810 01:45:47.196645 10758 tablet_replica.cc:330] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: stopping tablet replica
I20260810 01:45:47.196935 10758 raft_consensus.cc:2229] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:47.197093 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 10099
I20260810 01:45:47.199633 10758 raft_consensus.cc:2258] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:47.203603 10758 ts_tablet_manager.cc:1905] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:47.205920 10758 ts_tablet_manager.cc:1918] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:47.206009 10758 log.cc:1196] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/351b749e3dce41168156e3dcad5ab519
I20260810 01:45:47.206322 10758 ts_tablet_manager.cc:1939] T 351b749e3dce41168156e3dcad5ab519 P aa5962a1ca5f4adeb322c2070b1b58e7: Deleting consensus metadata
I20260810 01:45:47.207438 9964 catalog_manager.cc:4841] TS aa5962a1ca5f4adeb322c2070b1b58e7 (127.16.58.66:35165): tablet 351b749e3dce41168156e3dcad5ab519 (table test-table [id=a28e95fd9a514734b2307a963417e0ce]) successfully deleted
I20260810 01:45:47.220155 10761 tablet_replica.cc:330] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: stopping tablet replica
I20260810 01:45:47.220534 10761 raft_consensus.cc:2229] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:45:47.220984 10761 raft_consensus.cc:2258] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:47.224094 10761 ts_tablet_manager.cc:1905] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:47.226279 10761 ts_tablet_manager.cc:1918] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:47.226370 10761 log.cc:1196] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/351b749e3dce41168156e3dcad5ab519
I20260810 01:45:47.226686 10761 ts_tablet_manager.cc:1939] T 351b749e3dce41168156e3dcad5ab519 P 50a2c886b20047da8f928ecb7bf23dbc: Deleting consensus metadata
I20260810 01:45:47.227751 9965 catalog_manager.cc:4841] TS 50a2c886b20047da8f928ecb7bf23dbc (127.16.58.67:46679): tablet 351b749e3dce41168156e3dcad5ab519 (table test-table [id=a28e95fd9a514734b2307a963417e0ce]) successfully deleted
W20260810 01:45:47.229981 9964 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:42711 (error 108)
I20260810 01:45:47.230180 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 10297
I20260810 01:45:47.249490 10704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.249159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:42711 (local address 127.0.0.1:60496)
0810 01:45:47.249303 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:47.249384 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:42711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 01:45:47.249804 9964 catalog_manager.cc:4584] TS f5d57886266748908f3d9a36357dffee (127.16.58.65:42711): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 351b749e3dce41168156e3dcad5ab519: Network error: Client connection negotiation failed: client connection to 127.16.58.65:42711: connect: Connection refused (error 111)
I20260810 01:45:47.255038 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 10486
I20260810 01:45:47.269419 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 9940
2026-08-10T01:45:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2388 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T01:45:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:45:47Z Disabled control of system clock
I20260810 01:45:47.304033 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:34075
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:44389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:34075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:45:47.411064 10770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:47.411303 10770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:47.411336 10770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:47.415140 10770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:47.415189 10770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:47.415202 10770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:47.415222 10770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:47.415238 10770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:47.419754 10770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:34075
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:34075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:47.420689 10770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:47.421903 10770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:47.429817 10778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:47.429817 10776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:47.429842 10781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:47.430054 10770 server_base.cc:1034] running on GCE node
I20260810 01:45:47.430694 10770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:47.431733 10770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:47.432893 10770 hybrid_clock.cc:648] HybridClock initialized: now 1786326347432879 us; error 28 us; skew 500 ppm
I20260810 01:45:47.434607 10770 webserver.cc:460] Webserver started at http://127.16.58.126:33597/ using document root <none> and password file <none>
I20260810 01:45:47.435153 10770 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:47.435220 10770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:47.435410 10770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:47.437402 10770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1"
format_stamp: "Formatted at 2026-08-10 01:45:47 on dist-test-slave-jlzn"
server_key: "61c19754cdf7f5f22751951f87241773"
server_key_iv: "2b3501365255922d91494063a3d1bfdf"
server_key_version: "encryptionkey@0"
I20260810 01:45:47.437937 10770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1"
format_stamp: "Formatted at 2026-08-10 01:45:47 on dist-test-slave-jlzn"
server_key: "61c19754cdf7f5f22751951f87241773"
server_key_iv: "2b3501365255922d91494063a3d1bfdf"
server_key_version: "encryptionkey@0"
I20260810 01:45:47.441416 10770 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260810 01:45:47.443611 10790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:47.444777 10770 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:45:47.444888 10770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1"
format_stamp: "Formatted at 2026-08-10 01:45:47 on dist-test-slave-jlzn"
server_key: "61c19754cdf7f5f22751951f87241773"
server_key_iv: "2b3501365255922d91494063a3d1bfdf"
server_key_version: "encryptionkey@0"
I20260810 01:45:47.444977 10770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:47.465837 10770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:47.466540 10770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:47.466730 10770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:47.473426 10770 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:34075
I20260810 01:45:47.473446 10866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:34075 every 8 connection(s)
I20260810 01:45:47.474329 10770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:47.477391 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:47.478897 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 10770
I20260810 01:45:47.479030 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:45:47.479336 16617 external_mini_cluster.cc:1428] Setting key 4bebbd7ee7dddfd80d7bbf35ad0e3d59
I20260810 01:45:47.483835 10867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1: Bootstrap starting.
I20260810 01:45:47.486500 10867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:47.487206 10867 log.cc:824] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:47.488835 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.480830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59468 (local address 127.16.58.126:34075)
0810 01:45:47.481447 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.481462 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.481497 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:45:47.482152 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.482169 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.482547 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.482822 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:47.483234 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.484314 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.485502 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.485963 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.486075 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.486920 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:47.486925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:47.486938 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:47.487321 (+ 383us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:47.487397 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:47.487429 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:47.487513 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.487649 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.487937 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":122,"threads_started":1}
I20260810 01:45:47.489338 10867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1: No bootstrap required, opened a new log
I20260810 01:45:47.492712 10867 raft_consensus.cc:348] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34075 } }
I20260810 01:45:47.492914 10867 raft_consensus.cc:374] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:47.492965 10867 raft_consensus.cc:729] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c48cdadbdd544e8aa930ed7b83ea8bc1, State: Initialized, Role: FOLLOWER
I20260810 01:45:47.493381 10867 consensus_queue.cc:260] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34075 } }
I20260810 01:45:47.493526 10867 raft_consensus.cc:388] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:47.493599 10867 raft_consensus.cc:482] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:47.493712 10867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:47.494519 10867 raft_consensus.cc:504] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34075 } }
I20260810 01:45:47.494813 10867 leader_election.cc:302] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c48cdadbdd544e8aa930ed7b83ea8bc1; no voters:
I20260810 01:45:47.495080 10867 leader_election.cc:288] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:45:47.495184 10874 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:47.495398 10874 raft_consensus.cc:686] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [term 1 LEADER]: Becoming Leader. State: Replica: c48cdadbdd544e8aa930ed7b83ea8bc1, State: Running, Role: LEADER
I20260810 01:45:47.495679 10874 consensus_queue.cc:237] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34075 } }
I20260810 01:45:47.496232 10867 sys_catalog.cc:564] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:47.497162 10875 sys_catalog.cc:455] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34075 } } }
I20260810 01:45:47.497285 10875 sys_catalog.cc:458] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:47.497627 10883 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:47.497608 10876 sys_catalog.cc:455] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c48cdadbdd544e8aa930ed7b83ea8bc1. Latest consensus state: current_term: 1 leader_uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c48cdadbdd544e8aa930ed7b83ea8bc1" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34075 } } }
I20260810 01:45:47.498261 10876 sys_catalog.cc:458] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:47.500528 10883 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:47.505731 10883 catalog_manager.cc:1347] Generated new cluster ID: 99adf042265a4eee953a9d11bdb31b75
I20260810 01:45:47.505792 10883 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:47.511189 10883 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:45:47.512363 10883 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:47.519652 10883 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1: Generated new TSK 0
I20260810 01:45:47.520381 10883 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:45:47.524988 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34075
--builtin_ntp_servers=127.16.58.84:44389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:45:47.637450 10899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:47.637707 10899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:47.637759 10899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:47.641681 10899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:47.641733 10899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:47.641804 10899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:45:47.646534 10899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:47.647644 10899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:47.649083 10899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:47.658450 10912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:47.658459 10907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:47.658464 10909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:47.658746 10899 server_base.cc:1034] running on GCE node
I20260810 01:45:47.659197 10899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:47.659758 10899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:47.660923 10899 hybrid_clock.cc:648] HybridClock initialized: now 1786326347660903 us; error 34 us; skew 500 ppm
I20260810 01:45:47.662619 10899 webserver.cc:460] Webserver started at http://127.16.58.65:38821/ using document root <none> and password file <none>
I20260810 01:45:47.663159 10899 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:47.663233 10899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:47.663432 10899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:47.665449 10899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "bd01e578d0214dd797b1115de541175e"
format_stamp: "Formatted at 2026-08-10 01:45:47 on dist-test-slave-jlzn"
server_key: "144596cfe8d6b25c6e733fdcb013868a"
server_key_iv: "f3f34ce13a35ef31e55516f9a670cab2"
server_key_version: "encryptionkey@0"
I20260810 01:45:47.665992 10899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "bd01e578d0214dd797b1115de541175e"
format_stamp: "Formatted at 2026-08-10 01:45:47 on dist-test-slave-jlzn"
server_key: "144596cfe8d6b25c6e733fdcb013868a"
server_key_iv: "f3f34ce13a35ef31e55516f9a670cab2"
server_key_version: "encryptionkey@0"
I20260810 01:45:47.669416 10899 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:45:47.671620 10918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:47.672763 10899 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:47.672871 10899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "bd01e578d0214dd797b1115de541175e"
format_stamp: "Formatted at 2026-08-10 01:45:47 on dist-test-slave-jlzn"
server_key: "144596cfe8d6b25c6e733fdcb013868a"
server_key_iv: "f3f34ce13a35ef31e55516f9a670cab2"
server_key_version: "encryptionkey@0"
I20260810 01:45:47.672964 10899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:47.690325 10899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:47.690973 10899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:47.691144 10899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:47.691744 10899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:47.692704 10899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:47.692754 10899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:47.692808 10899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:47.692833 10899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:47.701136 10899 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:36007
I20260810 01:45:47.701191 11083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:36007 every 8 connection(s)
I20260810 01:45:47.701983 10899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:45:47.710167 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.703639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:36875 (local address 127.16.58.126:34075)
0810 01:45:47.703776 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.703780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.704767 (+ 987us) server_negotiation.cc:407] Connection header received
0810 01:45:47.706086 (+ 1319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.706089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.706139 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.706200 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:47.706984 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.707526 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.708602 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.708816 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.708889 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.709797 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:47.709800 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:47.709802 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:47.709814 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:47.709834 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:47.709841 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:47.709895 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.709993 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.710047 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:45:47.710933 11088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.704028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34075 (local address 127.16.58.65:36875)
0810 01:45:47.704640 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:47.704678 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:47.705901 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:47.706346 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:47.706352 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:47.706429 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:47.706879 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.706891 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.707615 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.707617 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.708512 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.708522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.708926 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.708928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.709072 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.709573 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:45:47.709574 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:47.709612 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:45:47.709669 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:47.709900 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:47.709904 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:47.709908 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:45:47.709987 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 01:45:47.710196 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":120,"threads_started":1}
I20260810 01:45:47.712024 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 10899
I20260810 01:45:47.712131 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:45:47.712107 11085 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34075
I20260810 01:45:47.712330 11085 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:47.712448 16617 external_mini_cluster.cc:1428] Setting key 3e6fbce5c2fc9876445915f69a39aca0
I20260810 01:45:47.712888 11085 heartbeater.cc:511] Master 127.16.58.126:34075 requested a full tablet report, sending...
I20260810 01:45:47.714315 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34075
--builtin_ntp_servers=127.16.58.84:44389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:45:47.714411 10815 ts_manager.cc:194] Registered new tserver with Master: bd01e578d0214dd797b1115de541175e (127.16.58.65:36007)
I20260810 01:45:47.715508 10815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.65:36875
W20260810 01:45:47.822926 11090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:47.823164 11090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:47.823206 11090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:47.827107 11090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:47.827162 11090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:47.827220 11090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:45:47.831786 11090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:47.832813 11090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:47.834090 11090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:47.843161 11104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:47.843149 11101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:47.843231 11090 server_base.cc:1034] running on GCE node
W20260810 01:45:47.843149 11102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:47.843787 11090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:47.844385 11090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:47.845536 11090 hybrid_clock.cc:648] HybridClock initialized: now 1786326347845516 us; error 31 us; skew 500 ppm
I20260810 01:45:47.847213 11090 webserver.cc:460] Webserver started at http://127.16.58.66:45739/ using document root <none> and password file <none>
I20260810 01:45:47.847744 11090 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:47.847832 11090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:47.848084 11090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:47.850098 11090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "528f567b31a74636a69a468b2a59d27f"
format_stamp: "Formatted at 2026-08-10 01:45:47 on dist-test-slave-jlzn"
server_key: "7d01f67370b7feb523ae6c9197b3676e"
server_key_iv: "5eaba680a01091e9f5bbb455ac042275"
server_key_version: "encryptionkey@0"
I20260810 01:45:47.850628 11090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "528f567b31a74636a69a468b2a59d27f"
format_stamp: "Formatted at 2026-08-10 01:45:47 on dist-test-slave-jlzn"
server_key: "7d01f67370b7feb523ae6c9197b3676e"
server_key_iv: "5eaba680a01091e9f5bbb455ac042275"
server_key_version: "encryptionkey@0"
I20260810 01:45:47.854125 11090 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:45:47.856521 11115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:47.857623 11090 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:45:47.857738 11090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "528f567b31a74636a69a468b2a59d27f"
format_stamp: "Formatted at 2026-08-10 01:45:47 on dist-test-slave-jlzn"
server_key: "7d01f67370b7feb523ae6c9197b3676e"
server_key_iv: "5eaba680a01091e9f5bbb455ac042275"
server_key_version: "encryptionkey@0"
I20260810 01:45:47.857828 11090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:47.873929 11090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:47.874562 11090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:47.874727 11090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:47.875267 11090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:47.876207 11090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:47.876256 11090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:47.876300 11090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:47.876329 11090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:47.884809 11090 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:39229
I20260810 01:45:47.884835 11286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:39229 every 8 connection(s)
I20260810 01:45:47.885677 11090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:45:47.890748 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 11090
I20260810 01:45:47.890846 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:45:47.891141 16617 external_mini_cluster.cc:1428] Setting key 572bdc595a9dd49f098446bbbd994d44
I20260810 01:45:47.893105 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34075
--builtin_ntp_servers=127.16.58.84:44389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:45:47.894970 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.887376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:47185 (local address 127.16.58.126:34075)
0810 01:45:47.887498 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:47.887502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:47.888560 (+ 1058us) server_negotiation.cc:407] Connection header received
0810 01:45:47.889921 (+ 1361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:47.889925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:47.889988 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:47.890065 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:47.890969 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.891694 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.893103 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.893404 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.893505 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.894457 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:47.894461 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:47.894464 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:47.894477 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:47.894499 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:47.894508 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:47.894579 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:47.894798 (+ 219us) server_negotiation.cc:299] Negotiation successful
0810 01:45:47.894862 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 01:45:47.895968 11289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:47.887721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34075 (local address 127.16.58.66:47185)
0810 01:45:47.888389 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:47.888429 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:47.889708 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:47.890242 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:47.890249 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:47.890330 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:47.890788 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.890803 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.891845 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.891850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.892977 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:47.892987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:47.893539 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:47.893543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:47.893684 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:47.894221 (+ 537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:45:47.894222 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:47.894261 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:45:47.894319 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:47.894581 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:47.894587 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:47.894592 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:45:47.894717 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 01:45:47.895002 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":113,"threads_started":1}
I20260810 01:45:47.896998 11287 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34075
I20260810 01:45:47.897236 11287 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:47.897696 11287 heartbeater.cc:511] Master 127.16.58.126:34075 requested a full tablet report, sending...
I20260810 01:45:47.898684 10815 ts_manager.cc:194] Registered new tserver with Master: 528f567b31a74636a69a468b2a59d27f (127.16.58.66:39229)
I20260810 01:45:47.899209 10815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.66:47185
W20260810 01:45:48.002552 11294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:48.002792 11294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:48.002843 11294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:48.006702 11294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:48.006752 11294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:48.006821 11294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:45:48.011464 11294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:44389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:48.012476 11294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:48.013742 11294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:48.022854 11308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:48.022886 11310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:48.022922 11307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:48.023028 11294 server_base.cc:1034] running on GCE node
I20260810 01:45:48.023429 11294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:48.024050 11294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:48.025211 11294 hybrid_clock.cc:648] HybridClock initialized: now 1786326348025184 us; error 29 us; skew 500 ppm
I20260810 01:45:48.026880 11294 webserver.cc:460] Webserver started at http://127.16.58.67:41921/ using document root <none> and password file <none>
I20260810 01:45:48.027431 11294 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:48.027493 11294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:48.027657 11294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:48.029601 11294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "a479ddacbedf4399b3e4f3b295e0b8b3"
format_stamp: "Formatted at 2026-08-10 01:45:48 on dist-test-slave-jlzn"
server_key: "4f0252e95c61a0ce35243bd0b2c97341"
server_key_iv: "11107cb03835a6f4265f96c0213ded00"
server_key_version: "encryptionkey@0"
I20260810 01:45:48.030097 11294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "a479ddacbedf4399b3e4f3b295e0b8b3"
format_stamp: "Formatted at 2026-08-10 01:45:48 on dist-test-slave-jlzn"
server_key: "4f0252e95c61a0ce35243bd0b2c97341"
server_key_iv: "11107cb03835a6f4265f96c0213ded00"
server_key_version: "encryptionkey@0"
I20260810 01:45:48.033530 11294 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:45:48.035722 11321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:48.036820 11294 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:48.036926 11294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "a479ddacbedf4399b3e4f3b295e0b8b3"
format_stamp: "Formatted at 2026-08-10 01:45:48 on dist-test-slave-jlzn"
server_key: "4f0252e95c61a0ce35243bd0b2c97341"
server_key_iv: "11107cb03835a6f4265f96c0213ded00"
server_key_version: "encryptionkey@0"
I20260810 01:45:48.037017 11294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:48.051537 11294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:48.052246 11294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:48.052418 11294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:48.052978 11294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:48.053898 11294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:48.053948 11294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:48.054003 11294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:48.054028 11294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:48.062301 11294 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:44131
I20260810 01:45:48.062354 11493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:44131 every 8 connection(s)
I20260810 01:45:48.063189 11294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:45:48.070330 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 11294
I20260810 01:45:48.070425 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:45:48.070737 16617 external_mini_cluster.cc:1428] Setting key 652878c3764b8ae41f0e11fa98e3596b
I20260810 01:45:48.072201 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.064933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:35309 (local address 127.16.58.126:34075)
0810 01:45:48.065073 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:48.065076 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:48.066034 (+ 958us) server_negotiation.cc:407] Connection header received
0810 01:45:48.067416 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:48.067419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:48.067478 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:48.067553 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:48.068470 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.069005 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.070154 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.070381 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.070483 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.071718 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:48.071721 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:48.071724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:48.071737 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:48.071762 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:48.071772 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:48.071863 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:48.071999 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 01:45:48.072059 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 01:45:48.073179 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.065286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34075 (local address 127.16.58.67:35309)
0810 01:45:48.065890 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:48.065930 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:48.067203 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:48.067732 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:48.067739 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:48.067859 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:48.068332 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.068346 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.069132 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.069135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.070016 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.070026 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.070591 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.070595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.070816 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.071459 (+ 643us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:45:48.071461 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:48.071511 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:45:48.071583 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:48.071862 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:48.071869 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:48.071873 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 01:45:48.071985 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 01:45:48.072261 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":102,"threads_started":1}
I20260810 01:45:48.074134 11494 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34075
I20260810 01:45:48.074347 11494 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:48.074818 11494 heartbeater.cc:511] Master 127.16.58.126:34075 requested a full tablet report, sending...
I20260810 01:45:48.075738 10815 ts_manager.cc:194] Registered new tserver with Master: a479ddacbedf4399b3e4f3b295e0b8b3 (127.16.58.67:44131)
I20260810 01:45:48.076339 10815 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.67:35309
I20260810 01:45:48.084553 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:45:48.089834 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.086358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59480 (local address 127.16.58.126:34075)
0810 01:45:48.086485 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:48.086490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:48.086653 (+ 163us) server_negotiation.cc:407] Connection header received
0810 01:45:48.086778 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:48.086781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:48.086825 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:48.086882 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:48.087137 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.087640 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.088490 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.088720 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.088806 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.089448 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:48.089452 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:48.089454 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:48.089467 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:48.089486 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:48.089494 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:48.089550 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:48.089648 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 01:45:48.089704 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:45:48.092321 10815 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59480:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:45:48.095173 10815 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:45:48.108349 11511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.102953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:36007 (local address 127.0.0.1:48246)
0810 01:45:48.103396 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:48.103442 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:48.103559 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:48.104179 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:48.104184 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:48.104205 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:48.104317 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.104323 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.105545 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.105548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.106752 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.106763 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.107835 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.107839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.107948 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.107991 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 01:45:48.108094 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 01:45:48.108216 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":67,"threads_started":1}
I20260810 01:45:48.108397 11512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.103092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48246 (local address 127.16.58.65:36007)
0810 01:45:48.103698 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:48.103710 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:48.103733 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:45:48.103832 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:48.103837 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:48.104038 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:48.104177 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:48.104453 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.105454 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.106891 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.107681 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.107830 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.108017 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:48.108136 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 01:45:48.108232 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":108,"threads_started":1}
I20260810 01:45:48.108690 11513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.103074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:44131 (local address 127.0.0.1:40986)
0810 01:45:48.103872 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:48.103884 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:48.103960 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:48.104586 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:48.104589 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:48.104608 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:48.104700 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.104706 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.106006 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.106010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.107075 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.107084 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.108323 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.108326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.108410 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.108434 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:45:48.108507 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 01:45:48.108566 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"mutex_wait_us":27,"thread_start_us":98,"threads_started":1}
I20260810 01:45:48.109031 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.103570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40986 (local address 127.16.58.67:44131)
0810 01:45:48.104031 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:48.104042 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:48.104063 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:45:48.104136 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:48.104141 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:48.104323 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:48.104468 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:48.104830 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.105889 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.107219 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.107984 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.108082 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.108261 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:48.108782 (+ 521us) server_negotiation.cc:299] Negotiation successful
0810 01:45:48.108879 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":155,"threads_started":1}
I20260810 01:45:48.109099 11510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.103623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:39229 (local address 127.0.0.1:35092)
0810 01:45:48.104699 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:48.104712 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:48.104793 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:48.105264 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:48.105267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:48.105283 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:48.105371 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.105377 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.106465 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.106468 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.107495 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.107507 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.108732 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.108735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.108814 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.108839 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:45:48.108908 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:45:48.108973 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1016,"mutex_wait_us":4,"thread_start_us":98,"threads_started":1}
I20260810 01:45:48.109618 11520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.104046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35092 (local address 127.16.58.66:39229)
0810 01:45:48.104482 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:48.104495 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:48.104880 (+ 385us) server_negotiation.cc:407] Connection header received
0810 01:45:48.104958 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:48.104963 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:48.105131 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:48.105273 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:48.105486 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.106363 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.107638 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.108417 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.108522 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.108676 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:48.109359 (+ 683us) server_negotiation.cc:299] Negotiation successful
0810 01:45:48.109460 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":160,"threads_started":1}
I20260810 01:45:48.111735 11187 tablet_service.cc:1467] Processing CreateTablet for tablet 6e0aab9dcbd64ae09e0643b4dead009f (DEFAULT_TABLE table=test-table [id=7e3e5a6de0794c7ca3e90980e7c6c817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:48.111765 10990 tablet_service.cc:1467] Processing CreateTablet for tablet 6e0aab9dcbd64ae09e0643b4dead009f (DEFAULT_TABLE table=test-table [id=7e3e5a6de0794c7ca3e90980e7c6c817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:48.111765 11393 tablet_service.cc:1467] Processing CreateTablet for tablet 6e0aab9dcbd64ae09e0643b4dead009f (DEFAULT_TABLE table=test-table [id=7e3e5a6de0794c7ca3e90980e7c6c817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:48.112709 11187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e0aab9dcbd64ae09e0643b4dead009f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:48.112789 11393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e0aab9dcbd64ae09e0643b4dead009f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:48.112789 10990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e0aab9dcbd64ae09e0643b4dead009f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:48.118214 11522 tablet_bootstrap.cc:492] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: Bootstrap starting.
I20260810 01:45:48.120241 11523 tablet_bootstrap.cc:492] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: Bootstrap starting.
I20260810 01:45:48.120368 11524 tablet_bootstrap.cc:492] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e: Bootstrap starting.
I20260810 01:45:48.120502 11522 tablet_bootstrap.cc:654] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:48.121371 11522 log.cc:824] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:48.122079 11524 tablet_bootstrap.cc:654] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:48.122167 11523 tablet_bootstrap.cc:654] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:48.122810 11524 log.cc:824] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:48.122941 11523 log.cc:824] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:48.123513 11522 tablet_bootstrap.cc:492] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: No bootstrap required, opened a new log
I20260810 01:45:48.123775 11522 ts_tablet_manager.cc:1397] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:45:48.124697 11523 tablet_bootstrap.cc:492] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: No bootstrap required, opened a new log
I20260810 01:45:48.124866 11523 ts_tablet_manager.cc:1397] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:45:48.124984 11524 tablet_bootstrap.cc:492] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e: No bootstrap required, opened a new log
I20260810 01:45:48.125175 11524 ts_tablet_manager.cc:1397] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 01:45:48.127871 11523 raft_consensus.cc:348] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } }
I20260810 01:45:48.128181 11523 raft_consensus.cc:374] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:48.128036 11522 raft_consensus.cc:348] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } }
I20260810 01:45:48.128259 11523 raft_consensus.cc:729] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a479ddacbedf4399b3e4f3b295e0b8b3, State: Initialized, Role: FOLLOWER
I20260810 01:45:48.128320 11522 raft_consensus.cc:374] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:48.128392 11522 raft_consensus.cc:729] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 528f567b31a74636a69a468b2a59d27f, State: Initialized, Role: FOLLOWER
I20260810 01:45:48.128758 11523 consensus_queue.cc:260] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } }
I20260810 01:45:48.128839 11522 consensus_queue.cc:260] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } }
I20260810 01:45:48.129256 11524 raft_consensus.cc:348] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } }
I20260810 01:45:48.129423 11494 heartbeater.cc:503] Master 127.16.58.126:34075 was elected leader, sending a full tablet report...
I20260810 01:45:48.129556 11524 raft_consensus.cc:374] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:48.129686 11524 raft_consensus.cc:729] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd01e578d0214dd797b1115de541175e, State: Initialized, Role: FOLLOWER
I20260810 01:45:48.129810 11523 ts_tablet_manager.cc:1428] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:45:48.129860 11522 ts_tablet_manager.cc:1428] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:45:48.130187 11524 consensus_queue.cc:260] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } }
I20260810 01:45:48.130259 11287 heartbeater.cc:503] Master 127.16.58.126:34075 was elected leader, sending a full tablet report...
I20260810 01:45:48.130990 11524 ts_tablet_manager.cc:1428] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:45:48.131336 11085 heartbeater.cc:503] Master 127.16.58.126:34075 was elected leader, sending a full tablet report...
W20260810 01:45:48.136488 11288 tablet.cc:2369] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:45:48.203028 11086 tablet.cc:2369] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:45:48.263489 11530 raft_consensus.cc:482] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:48.263710 11530 raft_consensus.cc:504] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } }
I20260810 01:45:48.264886 11530 leader_election.cc:288] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd01e578d0214dd797b1115de541175e (127.16.58.65:36007), 528f567b31a74636a69a468b2a59d27f (127.16.58.66:39229)
I20260810 01:45:48.268802 11496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.265106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:36007 (local address 127.16.58.67:59605)
0810 01:45:48.265232 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:48.265246 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:48.265340 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:48.265560 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:48.265562 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:48.265578 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:48.265702 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.265709 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.266662 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.266664 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.267774 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.267785 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.268472 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.268475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.268549 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.268570 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:45:48.268631 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 01:45:48.268687 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 01:45:48.268849 11512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.265233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:59605 (local address 127.16.58.65:36007)
0810 01:45:48.265366 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:48.265371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:48.265385 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:45:48.265439 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:48.265441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:48.265481 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:48.265543 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:48.265828 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.266556 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.267903 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.268372 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.268484 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.268534 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:48.268652 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 01:45:48.268717 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:45:48.269227 11534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.265406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:39229 (local address 127.16.58.67:36739)
0810 01:45:48.265824 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:48.265836 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:48.265909 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:48.266143 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:48.266144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:48.266156 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:48.266247 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.266251 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.267014 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.267017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.268070 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:48.268077 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.268832 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.268836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:48.268923 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.268948 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:45:48.269020 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 01:45:48.269078 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":147,"threads_started":1}
I20260810 01:45:48.269230 11520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.265522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:36739 (local address 127.16.58.66:39229)
0810 01:45:48.265650 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:48.265654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:48.265902 (+ 248us) server_negotiation.cc:407] Connection header received
0810 01:45:48.265983 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:48.265986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:48.266042 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:48.266119 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:48.266331 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.266907 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.268172 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.268698 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.268807 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.268849 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:48.269043 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 01:45:48.269117 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:45:48.269471 11026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0aab9dcbd64ae09e0643b4dead009f" candidate_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd01e578d0214dd797b1115de541175e" is_pre_election: true
I20260810 01:45:48.269806 11026 raft_consensus.cc:2454] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a479ddacbedf4399b3e4f3b295e0b8b3 in term 0.
I20260810 01:45:48.269879 11218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0aab9dcbd64ae09e0643b4dead009f" candidate_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "528f567b31a74636a69a468b2a59d27f" is_pre_election: true
I20260810 01:45:48.270144 11218 raft_consensus.cc:2454] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a479ddacbedf4399b3e4f3b295e0b8b3 in term 0.
I20260810 01:45:48.270316 11324 leader_election.cc:302] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a479ddacbedf4399b3e4f3b295e0b8b3, bd01e578d0214dd797b1115de541175e; no voters:
I20260810 01:45:48.270572 11530 raft_consensus.cc:2781] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:45:48.270666 11530 raft_consensus.cc:482] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:45:48.270720 11530 raft_consensus.cc:3037] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:48.271724 11530 raft_consensus.cc:504] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } }
I20260810 01:45:48.272056 11530 leader_election.cc:288] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [CANDIDATE]: Term 1 election: Requested vote from peers bd01e578d0214dd797b1115de541175e (127.16.58.65:36007), 528f567b31a74636a69a468b2a59d27f (127.16.58.66:39229)
I20260810 01:45:48.272351 11026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0aab9dcbd64ae09e0643b4dead009f" candidate_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd01e578d0214dd797b1115de541175e"
I20260810 01:45:48.272423 11218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e0aab9dcbd64ae09e0643b4dead009f" candidate_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "528f567b31a74636a69a468b2a59d27f"
I20260810 01:45:48.272459 11026 raft_consensus.cc:3037] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:48.272544 11218 raft_consensus.cc:3037] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:48.273442 11026 raft_consensus.cc:2454] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a479ddacbedf4399b3e4f3b295e0b8b3 in term 1.
I20260810 01:45:48.273511 11218 raft_consensus.cc:2454] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a479ddacbedf4399b3e4f3b295e0b8b3 in term 1.
I20260810 01:45:48.273715 11324 leader_election.cc:302] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a479ddacbedf4399b3e4f3b295e0b8b3, bd01e578d0214dd797b1115de541175e; no voters:
I20260810 01:45:48.273872 11530 raft_consensus.cc:2781] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:48.274070 11530 raft_consensus.cc:686] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 1 LEADER]: Becoming Leader. State: Replica: a479ddacbedf4399b3e4f3b295e0b8b3, State: Running, Role: LEADER
I20260810 01:45:48.274390 11530 consensus_queue.cc:237] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } }
I20260810 01:45:48.277488 10815 catalog_manager.cc:5495] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a479ddacbedf4399b3e4f3b295e0b8b3 (127.16.58.67). New cstate: current_term: 1 leader_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a479ddacbedf4399b3e4f3b295e0b8b3" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 44131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 } health_report { overall_health: UNKNOWN } } }
I20260810 01:45:48.304926 11518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.301617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41002 (local address 127.16.58.67:44131)
0810 01:45:48.301750 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:48.301754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:48.301768 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:45:48.301848 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:48.301851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:48.301901 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:48.301989 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:45:48.302233 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.302724 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.303526 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:48.303742 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:48.303858 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:48.304145 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:45:48.304542 (+ 397us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:45:48.304656 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:48.304748 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 01:45:48.304796 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:45:48.310567 11218 raft_consensus.cc:1261] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [term 1 FOLLOWER]: Refusing update from remote peer a479ddacbedf4399b3e4f3b295e0b8b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:48.310572 11026 raft_consensus.cc:1261] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [term 1 FOLLOWER]: Refusing update from remote peer a479ddacbedf4399b3e4f3b295e0b8b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:48.311275 11535 consensus_queue.cc:1035] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "528f567b31a74636a69a468b2a59d27f" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:48.311443 11530 consensus_queue.cc:1035] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd01e578d0214dd797b1115de541175e" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 36007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 01:45:48.314101 11495 tablet.cc:2369] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:45:48.317242 11539 mvcc.cc:205] Tried to move back new op lower bound from 7316792722672787456 to 7316792722534334464. Current Snapshot: MvccSnapshot[applied={T|T < 7316792722672787456}]
I20260810 01:45:48.319046 11543 mvcc.cc:205] Tried to move back new op lower bound from 7316792722672787456 to 7316792722534334464. Current Snapshot: MvccSnapshot[applied={T|T < 7316792722672787456}]
I20260810 01:45:48.321079 11540 mvcc.cc:205] Tried to move back new op lower bound from 7316792722672787456 to 7316792722534334464. Current Snapshot: MvccSnapshot[applied={T|T < 7316792722672787456}]
I20260810 01:45:48.326849 10813 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:48.326997 10813 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:48.329344 10813 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c48cdadbdd544e8aa930ed7b83ea8bc1: Sending DeleteTablet for 3 replicas of tablet 6e0aab9dcbd64ae09e0643b4dead009f
I20260810 01:45:48.330143 11393 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e0aab9dcbd64ae09e0643b4dead009f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:48 UTC) from {username='slave'} at 127.0.0.1:40986
I20260810 01:45:48.330220 11187 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e0aab9dcbd64ae09e0643b4dead009f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:48 UTC) from {username='slave'} at 127.0.0.1:35092
I20260810 01:45:48.330621 11555 tablet_replica.cc:330] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: stopping tablet replica
I20260810 01:45:48.330643 10990 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e0aab9dcbd64ae09e0643b4dead009f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:48 UTC) from {username='slave'} at 127.0.0.1:48246
I20260810 01:45:48.330811 11556 tablet_replica.cc:330] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: stopping tablet replica
I20260810 01:45:48.330991 11555 raft_consensus.cc:2229] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:45:48.331091 11556 raft_consensus.cc:2229] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:48.331424 11555 raft_consensus.cc:2258] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:48.331455 11556 raft_consensus.cc:2258] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:48.331993 11557 tablet_replica.cc:330] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e: stopping tablet replica
I20260810 01:45:48.332214 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 10899
I20260810 01:45:48.332286 11557 raft_consensus.cc:2229] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:48.332535 11557 raft_consensus.cc:2258] T 6e0aab9dcbd64ae09e0643b4dead009f P bd01e578d0214dd797b1115de541175e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:48.335795 11556 ts_tablet_manager.cc:1905] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:48.338586 11556 ts_tablet_manager.cc:1918] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:48.338680 11556 log.cc:1196] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/6e0aab9dcbd64ae09e0643b4dead009f
I20260810 01:45:48.338961 11556 ts_tablet_manager.cc:1939] T 6e0aab9dcbd64ae09e0643b4dead009f P 528f567b31a74636a69a468b2a59d27f: Deleting consensus metadata
I20260810 01:45:48.341091 11555 ts_tablet_manager.cc:1905] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:48.343189 11555 ts_tablet_manager.cc:1918] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:48.343281 11555 log.cc:1196] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/6e0aab9dcbd64ae09e0643b4dead009f
I20260810 01:45:48.343556 11555 ts_tablet_manager.cc:1939] T 6e0aab9dcbd64ae09e0643b4dead009f P a479ddacbedf4399b3e4f3b295e0b8b3: Deleting consensus metadata
I20260810 01:45:48.344007 10794 catalog_manager.cc:4841] TS 528f567b31a74636a69a468b2a59d27f (127.16.58.66:39229): tablet 6e0aab9dcbd64ae09e0643b4dead009f (table test-table [id=7e3e5a6de0794c7ca3e90980e7c6c817]) successfully deleted
I20260810 01:45:48.344604 10797 catalog_manager.cc:4841] TS a479ddacbedf4399b3e4f3b295e0b8b3 (127.16.58.67:44131): tablet 6e0aab9dcbd64ae09e0643b4dead009f (table test-table [id=7e3e5a6de0794c7ca3e90980e7c6c817]) successfully deleted
W20260810 01:45:48.345552 10794 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:36007 (error 108)
I20260810 01:45:48.345799 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 11090
I20260810 01:45:48.350560 11511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:48.350263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:36007 (local address 127.0.0.1:48256)
0810 01:45:48.350427 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:48.350486 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:36007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260810 01:45:48.350711 10794 catalog_manager.cc:4584] TS bd01e578d0214dd797b1115de541175e (127.16.58.65:36007): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6e0aab9dcbd64ae09e0643b4dead009f: Network error: Client connection negotiation failed: client connection to 127.16.58.65:36007: connect: Connection refused (error 111)
I20260810 01:45:48.364594 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 11294
I20260810 01:45:48.375267 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 10770
2026-08-10T01:45:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1103 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:45:48 dist-test-slave-jlzn krb5kdc[11561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:45:48 dist-test-slave-jlzn krb5kdc[11561](info): set up 2 sockets
Aug 10 01:45:48 dist-test-slave-jlzn krb5kdc[11561](info): commencing operation
krb5kdc: starting...
W20260810 01:45:49.498037 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:45:49 dist-test-slave-jlzn krb5kdc[11561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:45:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:45:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:45:49.614722 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:40843
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:35149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:40843
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:49.721606 11581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:49.721856 11581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:49.721908 11581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:49.725811 11581 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:49.725863 11581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:49.725888 11581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:49.725909 11581 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:49.725927 11581 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:49.730918 11581 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:35149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:40843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:40843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:49.731907 11581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:49.732846 11581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:49.740899 11594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:49.740957 11590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:49.740978 11589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:49.741042 11581 server_base.cc:1034] running on GCE node
I20260810 01:45:49.741711 11581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:49.742710 11581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:49.743880 11581 hybrid_clock.cc:648] HybridClock initialized: now 1786326349743863 us; error 31 us; skew 500 ppm
Aug 10 01:45:49 dist-test-slave-jlzn krb5kdc[11561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326349, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:49.746536 11581 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:45:49.747385 11581 webserver.cc:460] Webserver started at http://127.16.58.126:44605/ using document root <none> and password file <none>
I20260810 01:45:49.747934 11581 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:49.748023 11581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:49.748232 11581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:49.750174 11581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "20574a0fa6fd4b1e955e47dfd5f655ef"
format_stamp: "Formatted at 2026-08-10 01:45:49 on dist-test-slave-jlzn"
server_key: "be6d8210a84969428bc692a0a1205a38"
server_key_iv: "e85a2e2816219333a24356edc3efb744"
server_key_version: "encryptionkey@0"
I20260810 01:45:49.750728 11581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "20574a0fa6fd4b1e955e47dfd5f655ef"
format_stamp: "Formatted at 2026-08-10 01:45:49 on dist-test-slave-jlzn"
server_key: "be6d8210a84969428bc692a0a1205a38"
server_key_iv: "e85a2e2816219333a24356edc3efb744"
server_key_version: "encryptionkey@0"
I20260810 01:45:49.754251 11581 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:45:49.756487 11602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:49.757593 11581 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:49.757709 11581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "20574a0fa6fd4b1e955e47dfd5f655ef"
format_stamp: "Formatted at 2026-08-10 01:45:49 on dist-test-slave-jlzn"
server_key: "be6d8210a84969428bc692a0a1205a38"
server_key_iv: "e85a2e2816219333a24356edc3efb744"
server_key_version: "encryptionkey@0"
I20260810 01:45:49.757802 11581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:49.775318 11581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:49.778367 11581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:49.778553 11581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:49.785780 11581 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:40843
I20260810 01:45:49.785794 11684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:40843 every 8 connection(s)
I20260810 01:45:49.786696 11581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:49.789402 11686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:49.789681 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 11581
I20260810 01:45:49.789811 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:45:49.790099 16617 external_mini_cluster.cc:1428] Setting key 9447a83a82634368a1ecb88a8b0a7012
I20260810 01:45:49.795488 11686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef: Bootstrap starting.
I20260810 01:45:49.797547 11686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:49.798331 11686 log.cc:824] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:45:49 dist-test-slave-jlzn krb5kdc[11561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:49.800563 11686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef: No bootstrap required, opened a new log
I20260810 01:45:49.803465 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:49.791450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34878 (local address 127.16.58.126:40843)
0810 01:45:49.791919 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:49.791933 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:49.791973 (+ 40us) server_negotiation.cc:407] Connection header received
0810 01:45:49.792643 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:49.792660 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:49.792958 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:49.793249 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:49.794073 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:49.795060 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:49.795981 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:49.796433 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:49.796601 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:49.799182 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:49.799189 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:49.799205 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:49.799232 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:49.800885 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:49.801302 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:49.801308 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:49.801313 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:49.801427 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:49.801707 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:49.801710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:49.801712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:49.802087 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:49.802262 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:49.802548 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 01:45:49.802815 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":125,"threads_started":1}
I20260810 01:45:49.803992 11686 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20574a0fa6fd4b1e955e47dfd5f655ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40843 } }
I20260810 01:45:49.804243 11686 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:49.804299 11686 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20574a0fa6fd4b1e955e47dfd5f655ef, State: Initialized, Role: FOLLOWER
I20260810 01:45:49.804692 11686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20574a0fa6fd4b1e955e47dfd5f655ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40843 } }
I20260810 01:45:49.804822 11686 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:49.804888 11686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:49.804982 11686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:49.805886 11686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20574a0fa6fd4b1e955e47dfd5f655ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40843 } }
I20260810 01:45:49.806181 11686 leader_election.cc:302] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20574a0fa6fd4b1e955e47dfd5f655ef; no voters:
I20260810 01:45:49.806438 11686 leader_election.cc:288] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:45:49.806546 11695 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:49.806771 11695 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [term 1 LEADER]: Becoming Leader. State: Replica: 20574a0fa6fd4b1e955e47dfd5f655ef, State: Running, Role: LEADER
I20260810 01:45:49.807080 11695 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20574a0fa6fd4b1e955e47dfd5f655ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40843 } }
I20260810 01:45:49.807513 11686 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:49.808589 11698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20574a0fa6fd4b1e955e47dfd5f655ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20574a0fa6fd4b1e955e47dfd5f655ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40843 } } }
I20260810 01:45:49.808733 11698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:49.808991 11702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20574a0fa6fd4b1e955e47dfd5f655ef. Latest consensus state: current_term: 1 leader_uuid: "20574a0fa6fd4b1e955e47dfd5f655ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20574a0fa6fd4b1e955e47dfd5f655ef" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 40843 } } }
I20260810 01:45:49.809109 11714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:49.809175 11702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:49.812407 11714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:49.817018 11714 catalog_manager.cc:1347] Generated new cluster ID: f689aa4bd61242edae488d7ba19d11ce
I20260810 01:45:49.817081 11714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:49.829509 11714 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:45:49.830727 11714 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:49.844516 11714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef: Generated new TSK 0
I20260810 01:45:49.845326 11714 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:45:49.880440 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40843
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:35149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:49.987555 11732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:49.987783 11732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:49.987866 11732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:49.991750 11732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:49.991823 11732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:49.991901 11732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:45:49.996835 11732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:35149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:49.997722 11732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:49.998634 11732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:50.007639 11739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:50.007722 11737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:50.007887 11732 server_base.cc:1034] running on GCE node
W20260810 01:45:50.007722 11742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:50.008399 11732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:50.009016 11732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:50.010175 11732 hybrid_clock.cc:648] HybridClock initialized: now 1786326350010159 us; error 26 us; skew 500 ppm
Aug 10 01:45:50 dist-test-slave-jlzn krb5kdc[11561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326350, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:50.012818 11732 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:45:50.013641 11732 webserver.cc:460] Webserver started at http://127.16.58.65:37245/ using document root <none> and password file <none>
I20260810 01:45:50.014150 11732 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:50.014216 11732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:50.014402 11732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:50.016449 11732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "be945876580643918e8a7acd6ea4f5b0"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "4bfa70e8e1d2ef70d39506b9e4701145"
server_key_iv: "e3d31e279b0b7f7500dfdb5642f6494a"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.016992 11732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "be945876580643918e8a7acd6ea4f5b0"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "4bfa70e8e1d2ef70d39506b9e4701145"
server_key_iv: "e3d31e279b0b7f7500dfdb5642f6494a"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.020480 11732 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:45:50.022944 11756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.024082 11732 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260810 01:45:50.024192 11732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "be945876580643918e8a7acd6ea4f5b0"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "4bfa70e8e1d2ef70d39506b9e4701145"
server_key_iv: "e3d31e279b0b7f7500dfdb5642f6494a"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.024284 11732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:50.059077 11732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:50.062270 11732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:50.062448 11732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:50.063028 11732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:50.063875 11732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:50.063925 11732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.063979 11732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:50.064007 11732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.072429 11732 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:35433
I20260810 01:45:50.072463 11946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:35433 every 8 connection(s)
I20260810 01:45:50.073277 11732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:45:50.076577 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 11732
I20260810 01:45:50.076705 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:45:50.076983 16617 external_mini_cluster.cc:1428] Setting key 61d05ac2cbf8c55af9bf2c93ce5a3b6f
Aug 10 01:45:50 dist-test-slave-jlzn krb5kdc[11561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326350, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:50.086685 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.074966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:32851 (local address 127.16.58.126:40843)
0810 01:45:50.075088 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.075092 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.075887 (+ 795us) server_negotiation.cc:407] Connection header received
0810 01:45:50.077266 (+ 1379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.077269 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.077329 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.077401 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:50.078707 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.079223 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.080423 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.080653 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.080740 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.083235 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:50.083239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:50.083240 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:50.083265 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:50.084735 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:50.085214 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:50.085218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:50.085220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:50.085302 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:50.085618 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:50.085630 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:50.085632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:50.085810 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:50.085895 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.086379 (+ 484us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.086514 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:45:50.087412 11952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.075300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40843 (local address 127.16.58.65:32851)
0810 01:45:50.075745 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.075787 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.077059 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.077591 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.077598 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.078057 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:50.078557 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.078571 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.079346 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.079350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.080300 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.080310 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.080797 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.080801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.080964 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.081512 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:50.081527 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:50.083072 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:50.084842 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:50.084848 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:50.084860 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:50.085104 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:50.085388 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:50.085391 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:50.085393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:50.085525 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:50.085916 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:50.085922 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:50.086151 (+ 229us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.086309 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.086608 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":119,"threads_started":1}
I20260810 01:45:50.088608 11948 heartbeater.cc:347] Connected to a master server at 127.16.58.126:40843
I20260810 01:45:50.088811 11948 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:50.089335 11948 heartbeater.cc:511] Master 127.16.58.126:40843 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
I20260810 01:45:50.090790 11628 ts_manager.cc:194] Registered new tserver with Master: be945876580643918e8a7acd6ea4f5b0 (127.16.58.65:35433)
I20260810 01:45:50.092319 11628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:32851
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:45:50.103852 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40843
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:35149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:50.212057 11961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:50.212294 11961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:50.212333 11961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:50.216223 11961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:50.216270 11961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:50.216324 11961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:45:50.221294 11961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:35149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:50.222208 11961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:50.223124 11961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:50.232466 11969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:50.232472 11968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:50.232475 11972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:50.232525 11961 server_base.cc:1034] running on GCE node
I20260810 01:45:50.233065 11961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:50.233661 11961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:50.234858 11961 hybrid_clock.cc:648] HybridClock initialized: now 1786326350234839 us; error 25 us; skew 500 ppm
Aug 10 01:45:50 dist-test-slave-jlzn krb5kdc[11561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326350, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:50.240561 11961 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:45:50.241394 11961 webserver.cc:460] Webserver started at http://127.16.58.66:42155/ using document root <none> and password file <none>
I20260810 01:45:50.241910 11961 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:50.241971 11961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:50.242188 11961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:50.244225 11961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "5edaa4ea105946ce901f60952a357400"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "0244454f0498b2b532531f47bab063cc"
server_key_iv: "db211bb57d2f5880eeae00c12e34abc2"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.244761 11961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "5edaa4ea105946ce901f60952a357400"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "0244454f0498b2b532531f47bab063cc"
server_key_iv: "db211bb57d2f5880eeae00c12e34abc2"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.248221 11961 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260810 01:45:50.250447 11981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.251585 11961 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:50.251693 11961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "5edaa4ea105946ce901f60952a357400"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "0244454f0498b2b532531f47bab063cc"
server_key_iv: "db211bb57d2f5880eeae00c12e34abc2"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.251785 11961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:50.269654 11961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:50.272397 11961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:50.272574 11961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:50.273142 11961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:50.273936 11961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:50.273984 11961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.274047 11961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:50.274077 11961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.282362 11961 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:37847
I20260810 01:45:50.282388 12158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:37847 every 8 connection(s)
I20260810 01:45:50.283253 11961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:45:50.289283 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 11961
I20260810 01:45:50.289407 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:45:50.289673 16617 external_mini_cluster.cc:1428] Setting key 286e6f652eb2989f1879356d909a49e6
Aug 10 01:45:50 dist-test-slave-jlzn krb5kdc[11561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326350, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:50.296552 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.284932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:38737 (local address 127.16.58.126:40843)
0810 01:45:50.285097 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.285102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.285915 (+ 813us) server_negotiation.cc:407] Connection header received
0810 01:45:50.287107 (+ 1192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.287111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.287157 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.287228 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:50.288373 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.288916 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.290080 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.290318 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.290410 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.293101 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:50.293106 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:50.293109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:50.293151 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:50.294562 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:50.295044 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:50.295048 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:50.295049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:50.295155 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:50.295442 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:50.295445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:50.295447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:50.295666 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:50.295761 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.296265 (+ 504us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.296393 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 01:45:50.297369 12161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.285321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40843 (local address 127.16.58.66:38737)
0810 01:45:50.285761 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.285803 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.286920 (+ 1117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.287389 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.287395 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.287713 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:50.288224 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.288238 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.289014 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.289017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.289961 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.289972 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.290458 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.290461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.290605 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.291111 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:50.291126 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:50.292921 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:50.294677 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:50.294681 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:50.294692 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:50.294930 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:50.295235 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:50.295237 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:50.295238 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:50.295360 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:50.295753 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:50.295758 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:50.296012 (+ 254us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.296174 (+ 162us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.296440 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":111,"threads_started":1}
I20260810 01:45:50.298442 12159 heartbeater.cc:347] Connected to a master server at 127.16.58.126:40843
I20260810 01:45:50.298688 12159 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:50.299266 12159 heartbeater.cc:511] Master 127.16.58.126:40843 requested a full tablet report, sending...
I20260810 01:45:50.300397 11628 ts_manager.cc:194] Registered new tserver with Master: 5edaa4ea105946ce901f60952a357400 (127.16.58.66:37847)
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:45:50.300949 11628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:38737
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:45:50.316722 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40843
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:35149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:50.438812 12164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:50.439029 12164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:50.439067 12164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:50.442951 12164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:50.443003 12164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:50.443055 12164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:45:50.448151 12164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:35149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:40843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:50.449005 12164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:50.449903 12164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:50.458979 12174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:50.459093 12164 server_base.cc:1034] running on GCE node
W20260810 01:45:50.459007 12171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:50.459296 12169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:50.459676 12164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:50.460264 12164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:50.461416 12164 hybrid_clock.cc:648] HybridClock initialized: now 1786326350461403 us; error 34 us; skew 500 ppm
Aug 10 01:45:50 dist-test-slave-jlzn krb5kdc[11561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326350, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:50.464044 12164 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:45:50.464879 12164 webserver.cc:460] Webserver started at http://127.16.58.67:36581/ using document root <none> and password file <none>
I20260810 01:45:50.465391 12164 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:50.465456 12164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:50.465653 12164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:50.467574 12164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "541bb2ee5472425c8812de2a683c5cee"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "6d4355718ec0e16ac88bde9ac0cf02be"
server_key_iv: "4f5646e009e1733835b0ccbaed2aeea0"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.468146 12164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "541bb2ee5472425c8812de2a683c5cee"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "6d4355718ec0e16ac88bde9ac0cf02be"
server_key_iv: "4f5646e009e1733835b0ccbaed2aeea0"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.471580 12164 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:45:50.473826 12184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.474931 12164 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:50.475036 12164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "541bb2ee5472425c8812de2a683c5cee"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "6d4355718ec0e16ac88bde9ac0cf02be"
server_key_iv: "4f5646e009e1733835b0ccbaed2aeea0"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.475126 12164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:50.485724 12164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:50.488186 12164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:50.488348 12164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:50.488878 12164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:50.489646 12164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:50.489694 12164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.489744 12164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:50.489773 12164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.497975 12164 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:37589
I20260810 01:45:50.498000 12358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:37589 every 8 connection(s)
I20260810 01:45:50.498759 12164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:45:50.502081 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 12164
I20260810 01:45:50.502220 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:45:50.502532 16617 external_mini_cluster.cc:1428] Setting key 47697f5ba4eacb40e2a1f4b0eae52894
Aug 10 01:45:50 dist-test-slave-jlzn krb5kdc[11561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326350, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:50.511503 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.500450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:49139 (local address 127.16.58.126:40843)
0810 01:45:50.500592 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.500597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.501345 (+ 748us) server_negotiation.cc:407] Connection header received
0810 01:45:50.502749 (+ 1404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.502752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.502799 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.502878 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:50.504177 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.504761 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.505851 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.506074 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.506167 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.508337 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:50.508341 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:50.508344 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:50.508370 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:50.509636 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:50.510091 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:50.510094 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:50.510095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:50.510182 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:50.510498 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:50.510501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:50.510503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:50.510677 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:50.510764 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.511219 (+ 455us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.511335 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:45:50.512217 12362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.500786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:40843 (local address 127.16.58.67:49139)
0810 01:45:50.501198 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.501236 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.502519 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.503074 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.503083 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.503507 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:50.504041 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.504057 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.504880 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.504883 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.505733 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.505743 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.506209 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.506214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.506368 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.506804 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:50.506819 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:50.508182 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:50.509739 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:50.509745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:50.509758 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:50.509993 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:50.510270 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:50.510273 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:50.510275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:50.510406 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:50.510781 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:50.510787 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:50.510994 (+ 207us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.511146 (+ 152us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.511427 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":119,"threads_started":1}
I20260810 01:45:50.513206 12359 heartbeater.cc:347] Connected to a master server at 127.16.58.126:40843
I20260810 01:45:50.513396 12359 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:50.513803 12359 heartbeater.cc:511] Master 127.16.58.126:40843 requested a full tablet report, sending...
I20260810 01:45:50.514717 11628 ts_manager.cc:194] Registered new tserver with Master: 541bb2ee5472425c8812de2a683c5cee (127.16.58.67:37589)
I20260810 01:45:50.515323 11628 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:49139
I20260810 01:45:50.516177 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:45:50.525707 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.518266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34894 (local address 127.16.58.126:40843)
0810 01:45:50.518375 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.518379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.518566 (+ 187us) server_negotiation.cc:407] Connection header received
0810 01:45:50.518666 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.518669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.518709 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.518769 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:50.519441 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.519971 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.520799 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.521009 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.521092 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.522621 (+ 1529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:50.522625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:50.522627 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:50.522654 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:50.523933 (+ 1279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:50.524449 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:50.524452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:50.524454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:50.524535 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:50.524860 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:50.524864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:50.524866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:50.525056 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:50.525206 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.525473 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.525559 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:45:50.528244 11628 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34894:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:45:50.531091 11628 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:45:50.544875 12380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.539792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39222 (local address 127.16.58.66:37847)
0810 01:45:50.540448 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.540458 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.540480 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:45:50.540557 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.540563 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.540744 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.540896 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:50.541360 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.542358 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.543592 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.544210 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.544308 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.544462 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.544633 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.544727 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":119,"threads_started":1}
I20260810 01:45:50.544873 12379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.539624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:37847 (local address 127.0.0.1:39222)
0810 01:45:50.539942 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.539990 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.540122 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.541087 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.541090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.541110 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:50.541221 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.541228 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.542492 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.542495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.543470 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.543481 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.544330 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.544334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.544449 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.544488 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.544588 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.544720 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"spinlock_wait_cycles":2304,"thread_start_us":82,"threads_started":1}
I20260810 01:45:50.545063 12374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.539082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:35433 (local address 127.0.0.1:56642)
0810 01:45:50.540261 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.540273 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.540424 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.540883 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.540886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.540905 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:50.541009 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.541015 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.542085 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.542089 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.543349 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.543359 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.544651 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.544655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.544749 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.544773 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.544838 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.544905 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":60,"thread_start_us":110,"threads_started":1}
I20260810 01:45:50.545490 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.539412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56642 (local address 127.16.58.65:35433)
0810 01:45:50.540258 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.540274 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.540533 (+ 259us) server_negotiation.cc:407] Connection header received
0810 01:45:50.540609 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.540613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.540754 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.540896 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:50.541137 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.541943 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.543483 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.544336 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.544444 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.544588 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.545246 (+ 658us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.545346 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":133,"threads_started":1}
I20260810 01:45:50.546000 12375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.538955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:37589 (local address 127.0.0.1:34364)
0810 01:45:50.539941 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.539989 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.540122 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.540669 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.540675 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.540699 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:50.540819 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.540825 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.542204 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.542207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.544338 (+ 2131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.544347 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.545613 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.545617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.545703 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.545726 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.545796 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.545862 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"mutex_wait_us":885,"spinlock_wait_cycles":12416,"thread_start_us":60,"threads_started":1}
I20260810 01:45:50.546526 12376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.539112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.16.58.67:37589)
0810 01:45:50.539515 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.539527 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.540264 (+ 737us) server_negotiation.cc:407] Connection header received
0810 01:45:50.540345 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.540350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.540514 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.540650 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:50.540952 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.542067 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.544473 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.545299 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.545397 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.545541 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.546274 (+ 733us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.546367 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":104,"threads_started":1}
I20260810 01:45:50.547890 12057 tablet_service.cc:1467] Processing CreateTablet for tablet fc4a666b8eaa4f8493433afb449391c0 (DEFAULT_TABLE table=test-table [id=663f5ecb0d734d01a5870e7930047ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:50.548130 11835 tablet_service.cc:1467] Processing CreateTablet for tablet fc4a666b8eaa4f8493433afb449391c0 (DEFAULT_TABLE table=test-table [id=663f5ecb0d734d01a5870e7930047ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:50.548977 12057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc4a666b8eaa4f8493433afb449391c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:50.549057 11835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc4a666b8eaa4f8493433afb449391c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:50.550303 12267 tablet_service.cc:1467] Processing CreateTablet for tablet fc4a666b8eaa4f8493433afb449391c0 (DEFAULT_TABLE table=test-table [id=663f5ecb0d734d01a5870e7930047ed8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:50.551244 12267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc4a666b8eaa4f8493433afb449391c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:50.555531 12383 tablet_bootstrap.cc:492] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0: Bootstrap starting.
I20260810 01:45:50.556782 12386 tablet_bootstrap.cc:492] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: Bootstrap starting.
I20260810 01:45:50.557613 12383 tablet_bootstrap.cc:654] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:50.558008 12387 tablet_bootstrap.cc:492] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: Bootstrap starting.
I20260810 01:45:50.558979 12383 log.cc:824] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:50.559217 12386 tablet_bootstrap.cc:654] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:50.560133 12386 log.cc:824] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:50.560917 12387 tablet_bootstrap.cc:654] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:50.561196 12383 tablet_bootstrap.cc:492] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0: No bootstrap required, opened a new log
I20260810 01:45:50.561393 12383 ts_tablet_manager.cc:1397] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:45:50.561736 12387 log.cc:824] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:50.562091 12386 tablet_bootstrap.cc:492] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: No bootstrap required, opened a new log
I20260810 01:45:50.562287 12386 ts_tablet_manager.cc:1397] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:45:50.563639 12387 tablet_bootstrap.cc:492] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: No bootstrap required, opened a new log
I20260810 01:45:50.563824 12387 ts_tablet_manager.cc:1397] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:45:50.565024 12386 raft_consensus.cc:348] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.565049 12383 raft_consensus.cc:348] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.565253 12386 raft_consensus.cc:374] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:50.565295 12383 raft_consensus.cc:374] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:50.565327 12386 raft_consensus.cc:729] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5edaa4ea105946ce901f60952a357400, State: Initialized, Role: FOLLOWER
I20260810 01:45:50.565371 12383 raft_consensus.cc:729] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be945876580643918e8a7acd6ea4f5b0, State: Initialized, Role: FOLLOWER
I20260810 01:45:50.565775 12386 consensus_queue.cc:260] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.565845 12383 consensus_queue.cc:260] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.566383 12159 heartbeater.cc:503] Master 127.16.58.126:40843 was elected leader, sending a full tablet report...
I20260810 01:45:50.566658 12386 ts_tablet_manager.cc:1428] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 01:45:50.566802 12383 ts_tablet_manager.cc:1428] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:45:50.567150 11948 heartbeater.cc:503] Master 127.16.58.126:40843 was elected leader, sending a full tablet report...
I20260810 01:45:50.568253 12387 raft_consensus.cc:348] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.568532 12387 raft_consensus.cc:374] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:50.568594 12387 raft_consensus.cc:729] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 541bb2ee5472425c8812de2a683c5cee, State: Initialized, Role: FOLLOWER
I20260810 01:45:50.568980 12387 consensus_queue.cc:260] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.569672 12359 heartbeater.cc:503] Master 127.16.58.126:40843 was elected leader, sending a full tablet report...
I20260810 01:45:50.569923 12387 ts_tablet_manager.cc:1428] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
W20260810 01:45:50.574306 11950 tablet.cc:2369] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:45:50.604388 12394 raft_consensus.cc:482] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:50.604540 12394 raft_consensus.cc:504] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.605551 12394 leader_election.cc:288] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be945876580643918e8a7acd6ea4f5b0 (127.16.58.65:35433), 5edaa4ea105946ce901f60952a357400 (127.16.58.66:37847)
I20260810 01:45:50.609046 12393 raft_consensus.cc:482] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:50.609222 12393 raft_consensus.cc:504] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.609998 12362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.605746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:35433 (local address 127.16.58.67:39259)
0810 01:45:50.605867 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.605882 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.605961 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.606282 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.606285 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.606305 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:50.606420 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.606426 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.607364 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.607366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.608592 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.608603 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.609511 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.609515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.609660 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.609721 (+ 61us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.609791 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.609865 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":28}
I20260810 01:45:50.609997 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.605827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:39259 (local address 127.16.58.65:35433)
0810 01:45:50.605934 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.605938 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.605954 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:45:50.606063 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.606067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.606117 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.606193 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:50.606521 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.607264 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.608704 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.609286 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.609397 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.609448 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.609833 (+ 385us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.609904 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 01:45:50.610129 12380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.606115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:51219 (local address 127.16.58.66:37847)
0810 01:45:50.606243 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.606246 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.606350 (+ 104us) server_negotiation.cc:407] Connection header received
0810 01:45:50.606438 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.606440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.606490 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.606578 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:50.606816 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.607494 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.608893 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.609500 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.609621 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.609670 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.609935 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.610011 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:45:50.610302 12393 leader_election.cc:288] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 541bb2ee5472425c8812de2a683c5cee (127.16.58.67:37589), 5edaa4ea105946ce901f60952a357400 (127.16.58.66:37847)
I20260810 01:45:50.610473 12397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.605992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:37847 (local address 127.16.58.67:51219)
0810 01:45:50.606270 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.606282 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.606366 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.606598 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.606601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.606617 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:50.606722 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.606727 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.607591 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.607594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.608785 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.608793 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.609627 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.609638 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.609781 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.609808 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.610257 (+ 449us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.610336 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":19,"thread_start_us":117,"threads_started":1}
I20260810 01:45:50.611079 11867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc4a666b8eaa4f8493433afb449391c0" candidate_uuid: "541bb2ee5472425c8812de2a683c5cee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be945876580643918e8a7acd6ea4f5b0" is_pre_election: true
I20260810 01:45:50.611284 11867 raft_consensus.cc:2454] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 541bb2ee5472425c8812de2a683c5cee in term 0.
I20260810 01:45:50.611466 12083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc4a666b8eaa4f8493433afb449391c0" candidate_uuid: "541bb2ee5472425c8812de2a683c5cee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5edaa4ea105946ce901f60952a357400" is_pre_election: true
I20260810 01:45:50.611755 12083 raft_consensus.cc:2454] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 541bb2ee5472425c8812de2a683c5cee in term 0.
I20260810 01:45:50.611867 12189 leader_election.cc:302] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 541bb2ee5472425c8812de2a683c5cee, be945876580643918e8a7acd6ea4f5b0; no voters:
I20260810 01:45:50.612391 12394 raft_consensus.cc:2781] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:45:50.612473 12394 raft_consensus.cc:482] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:45:50.612514 12394 raft_consensus.cc:3037] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:50.613785 12394 raft_consensus.cc:504] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.614073 12394 leader_election.cc:288] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [CANDIDATE]: Term 1 election: Requested vote from peers be945876580643918e8a7acd6ea4f5b0 (127.16.58.65:35433), 5edaa4ea105946ce901f60952a357400 (127.16.58.66:37847)
I20260810 01:45:50.614341 12380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.610819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:53085 (local address 127.16.58.66:37847)
0810 01:45:50.611029 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.611032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.611043 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:45:50.611077 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.611080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.611115 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.611180 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:50.611516 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.612175 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.613232 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.613704 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.613807 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.613853 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.614148 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.614216 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260810 01:45:50.614537 11867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc4a666b8eaa4f8493433afb449391c0" candidate_uuid: "541bb2ee5472425c8812de2a683c5cee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be945876580643918e8a7acd6ea4f5b0"
I20260810 01:45:50.614693 12401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.610497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:37847 (local address 127.16.58.65:53085)
0810 01:45:50.610863 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.610876 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.610962 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.611226 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.611229 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.611245 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:50.611362 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.611369 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.612281 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.612284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.613102 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.613112 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.613913 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.613917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.614005 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.614030 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.614448 (+ 418us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.614519 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":98,"threads_started":1}
I20260810 01:45:50.614670 11867 raft_consensus.cc:3037] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:50.614760 12083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc4a666b8eaa4f8493433afb449391c0" candidate_uuid: "541bb2ee5472425c8812de2a683c5cee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5edaa4ea105946ce901f60952a357400"
I20260810 01:45:50.614863 12083 raft_consensus.cc:3037] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:50.615360 12398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.610582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:37589 (local address 127.16.58.65:40005)
0810 01:45:50.610941 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.610953 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:50.611033 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:50.612050 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:50.612054 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:50.612072 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:50.612172 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.612178 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.613055 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.613058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.614133 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:50.614145 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.614958 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.614962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:50.615059 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.615083 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:45:50.615160 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 01:45:50.615226 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":105,"threads_started":1}
I20260810 01:45:50.615358 12376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.611582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:40005 (local address 127.16.58.67:37589)
0810 01:45:50.611695 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.611699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.611711 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:45:50.611745 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.611748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.611788 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.611876 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:50.612291 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.612920 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.614280 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.614831 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.614940 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.614981 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.615184 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.615258 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:45:50.615828 12298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc4a666b8eaa4f8493433afb449391c0" candidate_uuid: "be945876580643918e8a7acd6ea4f5b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "541bb2ee5472425c8812de2a683c5cee" is_pre_election: true
I20260810 01:45:50.615926 11867 raft_consensus.cc:2454] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 541bb2ee5472425c8812de2a683c5cee in term 1.
I20260810 01:45:50.616041 12298 raft_consensus.cc:2379] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be945876580643918e8a7acd6ea4f5b0 in current term 1: Already voted for candidate 541bb2ee5472425c8812de2a683c5cee in this term.
I20260810 01:45:50.616374 12189 leader_election.cc:302] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 541bb2ee5472425c8812de2a683c5cee, be945876580643918e8a7acd6ea4f5b0; no voters:
I20260810 01:45:50.616442 12083 raft_consensus.cc:2454] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 541bb2ee5472425c8812de2a683c5cee in term 1.
I20260810 01:45:50.616480 12082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc4a666b8eaa4f8493433afb449391c0" candidate_uuid: "be945876580643918e8a7acd6ea4f5b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5edaa4ea105946ce901f60952a357400" is_pre_election: true
I20260810 01:45:50.616616 12394 raft_consensus.cc:2781] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:50.616657 12082 raft_consensus.cc:2379] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be945876580643918e8a7acd6ea4f5b0 in current term 1: Already voted for candidate 541bb2ee5472425c8812de2a683c5cee in this term.
I20260810 01:45:50.616844 12394 raft_consensus.cc:686] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 1 LEADER]: Becoming Leader. State: Replica: 541bb2ee5472425c8812de2a683c5cee, State: Running, Role: LEADER
I20260810 01:45:50.617110 11759 leader_election.cc:302] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be945876580643918e8a7acd6ea4f5b0; no voters: 541bb2ee5472425c8812de2a683c5cee, 5edaa4ea105946ce901f60952a357400
I20260810 01:45:50.617182 12394 consensus_queue.cc:237] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } }
I20260810 01:45:50.617362 12393 raft_consensus.cc:2726] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 01:45:50.620265 11626 catalog_manager.cc:5495] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee reported cstate change: term changed from 0 to 1, leader changed from <none> to 541bb2ee5472425c8812de2a683c5cee (127.16.58.67). New cstate: current_term: 1 leader_uuid: "541bb2ee5472425c8812de2a683c5cee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "541bb2ee5472425c8812de2a683c5cee" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 37589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 } health_report { overall_health: UNKNOWN } } }
I20260810 01:45:50.640358 12376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.637299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34370 (local address 127.16.58.67:37589)
0810 01:45:50.637418 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.637421 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.637433 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:45:50.637542 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.637544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.637591 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.637677 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:45:50.637862 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.638322 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.639086 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.639290 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.639358 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.639587 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:45:50.640002 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:45:50.640110 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.640181 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.640208 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:45:50.645573 12082 raft_consensus.cc:1261] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 1 FOLLOWER]: Refusing update from remote peer 541bb2ee5472425c8812de2a683c5cee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:50.645591 11867 raft_consensus.cc:1261] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0 [term 1 FOLLOWER]: Refusing update from remote peer 541bb2ee5472425c8812de2a683c5cee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:50.646173 12402 consensus_queue.cc:1035] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [LEADER]: Connected to new peer: Peer: permanent_uuid: "be945876580643918e8a7acd6ea4f5b0" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:50.646337 12394 consensus_queue.cc:1035] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5edaa4ea105946ce901f60952a357400" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 37847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:50.654186 12408 mvcc.cc:205] Tried to move back new op lower bound from 7316792732238217216 to 7316792732130795520. Current Snapshot: MvccSnapshot[applied={T|T < 7316792732238217216}]
I20260810 01:45:50.654227 12411 mvcc.cc:205] Tried to move back new op lower bound from 7316792732238217216 to 7316792732130795520. Current Snapshot: MvccSnapshot[applied={T|T < 7316792732238217216}]
I20260810 01:45:50.664739 11628 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:50.664912 11628 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34894:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:50.667197 11628 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 20574a0fa6fd4b1e955e47dfd5f655ef: Sending DeleteTablet for 3 replicas of tablet fc4a666b8eaa4f8493433afb449391c0
I20260810 01:45:50.667940 12267 tablet_service.cc:1514] Processing DeleteTablet for tablet fc4a666b8eaa4f8493433afb449391c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:50 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:34364
I20260810 01:45:50.667979 12057 tablet_service.cc:1514] Processing DeleteTablet for tablet fc4a666b8eaa4f8493433afb449391c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:50 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:39222
I20260810 01:45:50.668042 11835 tablet_service.cc:1514] Processing DeleteTablet for tablet fc4a666b8eaa4f8493433afb449391c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:50 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:56642
I20260810 01:45:50.668455 12423 tablet_replica.cc:330] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: stopping tablet replica
I20260810 01:45:50.668552 12427 tablet_replica.cc:330] T fc4a666b8eaa4f8493433afb449391c0 P be945876580643918e8a7acd6ea4f5b0: stopping tablet replica
I20260810 01:45:50.668803 12424 tablet_replica.cc:330] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: stopping tablet replica
I20260810 01:45:50.668803 12423 raft_consensus.cc:2229] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:45:50.669059 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 11732
I20260810 01:45:50.671520 12423 raft_consensus.cc:2258] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:50.674649 12423 ts_tablet_manager.cc:1905] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:50.677989 12423 ts_tablet_manager.cc:1918] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:50.678102 12423 log.cc:1196] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/fc4a666b8eaa4f8493433afb449391c0
I20260810 01:45:50.678510 12423 ts_tablet_manager.cc:1939] T fc4a666b8eaa4f8493433afb449391c0 P 541bb2ee5472425c8812de2a683c5cee: Deleting consensus metadata
I20260810 01:45:50.680768 12424 raft_consensus.cc:2229] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:50.680755 11609 catalog_manager.cc:4841] TS 541bb2ee5472425c8812de2a683c5cee (127.16.58.67:37589): tablet fc4a666b8eaa4f8493433afb449391c0 (table test-table [id=663f5ecb0d734d01a5870e7930047ed8]) successfully deleted
I20260810 01:45:50.681113 12424 raft_consensus.cc:2258] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:50.686511 12424 ts_tablet_manager.cc:1905] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:50.689193 12424 ts_tablet_manager.cc:1918] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:50.689289 12424 log.cc:1196] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/fc4a666b8eaa4f8493433afb449391c0
I20260810 01:45:50.689633 12424 ts_tablet_manager.cc:1939] T fc4a666b8eaa4f8493433afb449391c0 P 5edaa4ea105946ce901f60952a357400: Deleting consensus metadata
I20260810 01:45:50.690809 11607 catalog_manager.cc:4841] TS 5edaa4ea105946ce901f60952a357400 (127.16.58.66:37847): tablet fc4a666b8eaa4f8493433afb449391c0 (table test-table [id=663f5ecb0d734d01a5870e7930047ed8]) successfully deleted
W20260810 01:45:50.691671 11607 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:35433 (error 108)
I20260810 01:45:50.691743 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 11961
I20260810 01:45:50.694007 12375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.693749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:35433 (local address 127.0.0.1:56656)
0810 01:45:50.693876 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:50.693936 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:35433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 01:45:50.694132 11607 catalog_manager.cc:4584] TS be945876580643918e8a7acd6ea4f5b0 (127.16.58.65:35433): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fc4a666b8eaa4f8493433afb449391c0: Network error: Client connection negotiation failed: client connection to 127.16.58.65:35433: connect: Connection refused (error 111)
I20260810 01:45:50.701475 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 12164
I20260810 01:45:50.710346 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 11581
2026-08-10T01:45:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2335 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T01:45:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:45:50Z Disabled control of system clock
I20260810 01:45:50.743468 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:37069
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:37069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:45:50.850855 12435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:50.851099 12435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:50.851145 12435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:50.855022 12435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:50.855080 12435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:50.855100 12435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:50.855120 12435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:50.855139 12435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:50.859683 12435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:37069
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:37069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:50.860666 12435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:50.861958 12435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:50.871444 12443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:50.871444 12442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:50.871745 12435 server_base.cc:1034] running on GCE node
W20260810 01:45:50.871883 12446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:50.872413 12435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:50.873395 12435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:50.874552 12435 hybrid_clock.cc:648] HybridClock initialized: now 1786326350874535 us; error 33 us; skew 500 ppm
I20260810 01:45:50.882136 12435 webserver.cc:460] Webserver started at http://127.16.58.126:39705/ using document root <none> and password file <none>
I20260810 01:45:50.882659 12435 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:50.882717 12435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:50.882884 12435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:50.884893 12435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "b5864475b5964a09b9f6751212f26580"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "6dbf42db678cb7136f7313c4c6287187"
server_key_iv: "7c39be2d433d00b5aa1c21a9d1020905"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.885433 12435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "b5864475b5964a09b9f6751212f26580"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "6dbf42db678cb7136f7313c4c6287187"
server_key_iv: "7c39be2d433d00b5aa1c21a9d1020905"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.889024 12435 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:45:50.891218 12458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:50.892382 12435 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:50.892493 12435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "b5864475b5964a09b9f6751212f26580"
format_stamp: "Formatted at 2026-08-10 01:45:50 on dist-test-slave-jlzn"
server_key: "6dbf42db678cb7136f7313c4c6287187"
server_key_iv: "7c39be2d433d00b5aa1c21a9d1020905"
server_key_version: "encryptionkey@0"
I20260810 01:45:50.892594 12435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:50.919919 12435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:50.920549 12435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:50.920696 12435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:50.927470 12435 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:37069
I20260810 01:45:50.927491 12526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:37069 every 8 connection(s)
I20260810 01:45:50.928423 12435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:50.929533 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 12435
I20260810 01:45:50.929665 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:45:50.929980 16617 external_mini_cluster.cc:1428] Setting key 479568f14da69d39455939eeec025bad
I20260810 01:45:50.932047 12527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:50.937386 12527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580: Bootstrap starting.
I20260810 01:45:50.938968 12531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:50.931442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33262 (local address 127.16.58.126:37069)
0810 01:45:50.932226 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:50.932248 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:50.932286 (+ 38us) server_negotiation.cc:407] Connection header received
0810 01:45:50.932931 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:50.932946 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:50.933322 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:50.933621 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:50.934062 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.935013 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.935905 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:50.936362 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:50.936509 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:50.937320 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:50.937325 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:50.937337 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:50.937734 (+ 397us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:50.937792 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:50.937813 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:50.937897 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:50.938046 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 01:45:50.938292 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":172,"threads_started":1}
I20260810 01:45:50.939687 12527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:50.940474 12527 log.cc:824] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:50.942283 12527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580: No bootstrap required, opened a new log
I20260810 01:45:50.945765 12527 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5864475b5964a09b9f6751212f26580" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37069 } }
I20260810 01:45:50.945971 12527 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:50.946029 12527 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5864475b5964a09b9f6751212f26580, State: Initialized, Role: FOLLOWER
I20260810 01:45:50.946410 12527 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5864475b5964a09b9f6751212f26580" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37069 } }
I20260810 01:45:50.946529 12527 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:50.946589 12527 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:50.946682 12527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:50.947503 12527 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5864475b5964a09b9f6751212f26580" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37069 } }
I20260810 01:45:50.947832 12527 leader_election.cc:302] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5864475b5964a09b9f6751212f26580; no voters:
I20260810 01:45:50.948117 12527 leader_election.cc:288] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:45:50.948227 12534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:50.948431 12534 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [term 1 LEADER]: Becoming Leader. State: Replica: b5864475b5964a09b9f6751212f26580, State: Running, Role: LEADER
I20260810 01:45:50.948722 12534 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5864475b5964a09b9f6751212f26580" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37069 } }
I20260810 01:45:50.949220 12527 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:50.950181 12535 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5864475b5964a09b9f6751212f26580" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5864475b5964a09b9f6751212f26580" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37069 } } }
I20260810 01:45:50.950388 12536 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5864475b5964a09b9f6751212f26580. Latest consensus state: current_term: 1 leader_uuid: "b5864475b5964a09b9f6751212f26580" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5864475b5964a09b9f6751212f26580" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37069 } } }
I20260810 01:45:50.950533 12536 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:50.950495 12535 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:50.951395 12549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:50.954013 12549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:50.959012 12549 catalog_manager.cc:1347] Generated new cluster ID: 20caa1456969468580987bb7ef6f8651
I20260810 01:45:50.959077 12549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:50.968078 12549 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:45:50.968992 12549 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:50.976660 12549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580: Generated new TSK 0
I20260810 01:45:50.977283 12549 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:45:50.987920 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:37069
--builtin_ntp_servers=127.16.58.84:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:45:51.099721 12562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:51.100024 12562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:51.100063 12562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:51.103950 12562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:51.103994 12562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:51.104043 12562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:45:51.108547 12562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:37069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:51.109431 12562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:51.110673 12562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:51.120106 12576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:51.120323 12562 server_base.cc:1034] running on GCE node
W20260810 01:45:51.120276 12573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:51.120448 12568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:51.120816 12562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:51.121408 12562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:51.122561 12562 hybrid_clock.cc:648] HybridClock initialized: now 1786326351122540 us; error 35 us; skew 500 ppm
I20260810 01:45:51.124264 12562 webserver.cc:460] Webserver started at http://127.16.58.65:33563/ using document root <none> and password file <none>
I20260810 01:45:51.124779 12562 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:51.124836 12562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:51.125003 12562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:51.126935 12562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "b3f4a70fc3b34d3ca9e95816d6edba98"
format_stamp: "Formatted at 2026-08-10 01:45:51 on dist-test-slave-jlzn"
server_key: "c2ac7b0305124094a875093b2ef3a01b"
server_key_iv: "5a3a0247b83e5a607d7c680bf9ef5df1"
server_key_version: "encryptionkey@0"
I20260810 01:45:51.127441 12562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "b3f4a70fc3b34d3ca9e95816d6edba98"
format_stamp: "Formatted at 2026-08-10 01:45:51 on dist-test-slave-jlzn"
server_key: "c2ac7b0305124094a875093b2ef3a01b"
server_key_iv: "5a3a0247b83e5a607d7c680bf9ef5df1"
server_key_version: "encryptionkey@0"
I20260810 01:45:51.130846 12562 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:45:51.133196 12584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:51.134322 12562 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:45:51.134439 12562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "b3f4a70fc3b34d3ca9e95816d6edba98"
format_stamp: "Formatted at 2026-08-10 01:45:51 on dist-test-slave-jlzn"
server_key: "c2ac7b0305124094a875093b2ef3a01b"
server_key_iv: "5a3a0247b83e5a607d7c680bf9ef5df1"
server_key_version: "encryptionkey@0"
I20260810 01:45:51.134529 12562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:51.147324 12562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:51.147964 12562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:51.148136 12562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:51.148674 12562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:51.149650 12562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:51.149701 12562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:51.149753 12562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:51.149782 12562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:51.158192 12562 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:39795
I20260810 01:45:51.158246 12754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:39795 every 8 connection(s)
I20260810 01:45:51.159092 12562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:45:51.164558 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 12562
I20260810 01:45:51.164664 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:45:51.164927 16617 external_mini_cluster.cc:1428] Setting key e88651292f386abe825f231104d98a31
I20260810 01:45:51.166972 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:37069
--builtin_ntp_servers=127.16.58.84:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:45:51.168262 12531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.160844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:57443 (local address 127.16.58.126:37069)
0810 01:45:51.161016 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.161020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.162020 (+ 1000us) server_negotiation.cc:407] Connection header received
0810 01:45:51.163299 (+ 1279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.163302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.163353 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.163423 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:51.164323 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.164900 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.166239 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.166514 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.166594 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.167821 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:51.167824 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:51.167826 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:51.167838 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:51.167859 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:51.167867 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:51.167923 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.168076 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.168151 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 01:45:51.169207 12759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.161245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:37069 (local address 127.16.58.65:57443)
0810 01:45:51.161878 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:51.161916 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:51.163128 (+ 1212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:51.163580 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:51.163587 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:51.163674 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:51.164190 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.164203 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.165037 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.165041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.166123 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.166135 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.166679 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.166685 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.166882 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.167503 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:45:51.167505 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:51.167559 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:45:51.167648 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:51.167939 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:51.167948 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:51.167953 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 01:45:51.168075 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 01:45:51.168348 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":116,"threads_started":1}
I20260810 01:45:51.170323 12756 heartbeater.cc:347] Connected to a master server at 127.16.58.126:37069
I20260810 01:45:51.170539 12756 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:51.171012 12756 heartbeater.cc:511] Master 127.16.58.126:37069 requested a full tablet report, sending...
I20260810 01:45:51.172679 12479 ts_manager.cc:194] Registered new tserver with Master: b3f4a70fc3b34d3ca9e95816d6edba98 (127.16.58.65:39795)
I20260810 01:45:51.174244 12479 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.65:57443
W20260810 01:45:51.278852 12762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:51.279111 12762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:51.279156 12762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:51.283042 12762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:51.283089 12762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:51.283145 12762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:45:51.287860 12762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:37069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12762
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:51.288822 12762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:51.290107 12762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:51.299464 12773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:51.299459 12772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:51.299485 12776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:51.299515 12762 server_base.cc:1034] running on GCE node
I20260810 01:45:51.300113 12762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:51.300683 12762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:51.301837 12762 hybrid_clock.cc:648] HybridClock initialized: now 1786326351301817 us; error 39 us; skew 500 ppm
I20260810 01:45:51.303467 12762 webserver.cc:460] Webserver started at http://127.16.58.66:46789/ using document root <none> and password file <none>
I20260810 01:45:51.304046 12762 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:51.304116 12762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:51.304306 12762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:51.306231 12762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "5ffd6fba244646f8b147d9b8efeb126a"
format_stamp: "Formatted at 2026-08-10 01:45:51 on dist-test-slave-jlzn"
server_key: "187421e85b88f61228e8d25e5efea71f"
server_key_iv: "30830b38cb034708b29338da54425eae"
server_key_version: "encryptionkey@0"
I20260810 01:45:51.306762 12762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "5ffd6fba244646f8b147d9b8efeb126a"
format_stamp: "Formatted at 2026-08-10 01:45:51 on dist-test-slave-jlzn"
server_key: "187421e85b88f61228e8d25e5efea71f"
server_key_iv: "30830b38cb034708b29338da54425eae"
server_key_version: "encryptionkey@0"
I20260810 01:45:51.310187 12762 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:45:51.312518 12783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:51.313643 12762 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:51.313752 12762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "5ffd6fba244646f8b147d9b8efeb126a"
format_stamp: "Formatted at 2026-08-10 01:45:51 on dist-test-slave-jlzn"
server_key: "187421e85b88f61228e8d25e5efea71f"
server_key_iv: "30830b38cb034708b29338da54425eae"
server_key_version: "encryptionkey@0"
I20260810 01:45:51.313846 12762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:51.325554 12762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:51.326138 12762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:51.326295 12762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:51.326824 12762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:51.327704 12762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:51.327752 12762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:51.327842 12762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:51.327872 12762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:51.335919 12762 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:34069
I20260810 01:45:51.335963 12983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:34069 every 8 connection(s)
I20260810 01:45:51.336751 12762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:45:51.344659 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 12762
I20260810 01:45:51.344794 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:45:51.345129 16617 external_mini_cluster.cc:1428] Setting key 325e0bc271a2dc3802c2f87474d48d35
I20260810 01:45:51.345504 12531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.338437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:51541 (local address 127.16.58.126:37069)
0810 01:45:51.338568 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.338571 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.339567 (+ 996us) server_negotiation.cc:407] Connection header received
0810 01:45:51.340969 (+ 1402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.340972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.341035 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.341114 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:51.341982 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.342506 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.343637 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.343887 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.343978 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.345038 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:51.345041 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:51.345043 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:51.345056 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:51.345077 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:51.345087 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:51.345151 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.345325 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.345389 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:45:51.346556 12991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.338809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:37069 (local address 127.16.58.66:51541)
0810 01:45:51.339418 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:51.339456 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:51.340753 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:51.341295 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:51.341302 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:51.341379 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:51.341834 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.341846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.342641 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.342644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.343506 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.343515 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.344040 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.344044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.344201 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.344743 (+ 542us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:45:51.344745 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:51.344803 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:45:51.344885 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:51.345176 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:51.345185 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:51.345191 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:45:51.345311 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 01:45:51.345575 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":116,"threads_started":1}
I20260810 01:45:51.347345 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:37069
--builtin_ntp_servers=127.16.58.84:42189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:45:51.347599 12984 heartbeater.cc:347] Connected to a master server at 127.16.58.126:37069
I20260810 01:45:51.347851 12984 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:51.348403 12984 heartbeater.cc:511] Master 127.16.58.126:37069 requested a full tablet report, sending...
I20260810 01:45:51.349421 12479 ts_manager.cc:194] Registered new tserver with Master: 5ffd6fba244646f8b147d9b8efeb126a (127.16.58.66:34069)
I20260810 01:45:51.350076 12479 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.66:51541
W20260810 01:45:51.462345 12992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:51.462594 12992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:51.462628 12992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:51.466511 12992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:51.466560 12992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:51.466610 12992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:45:51.471223 12992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:42189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:37069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:51.472213 12992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:51.473474 12992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:51.482786 13001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:51.482748 12999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:51.482911 12992 server_base.cc:1034] running on GCE node
W20260810 01:45:51.482751 12998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:51.483522 12992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:51.484176 12992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:51.485329 12992 hybrid_clock.cc:648] HybridClock initialized: now 1786326351485309 us; error 31 us; skew 500 ppm
I20260810 01:45:51.487066 12992 webserver.cc:460] Webserver started at http://127.16.58.67:39129/ using document root <none> and password file <none>
I20260810 01:45:51.487591 12992 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:51.487664 12992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:51.487898 12992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:51.489835 12992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "6cba05c665214c5193fc4422158a14e0"
format_stamp: "Formatted at 2026-08-10 01:45:51 on dist-test-slave-jlzn"
server_key: "5b851c1ad87d06a85b463b57efcd436d"
server_key_iv: "a230c96f703827a1072e526731b0908f"
server_key_version: "encryptionkey@0"
I20260810 01:45:51.490391 12992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "6cba05c665214c5193fc4422158a14e0"
format_stamp: "Formatted at 2026-08-10 01:45:51 on dist-test-slave-jlzn"
server_key: "5b851c1ad87d06a85b463b57efcd436d"
server_key_iv: "a230c96f703827a1072e526731b0908f"
server_key_version: "encryptionkey@0"
I20260810 01:45:51.493852 12992 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:45:51.496186 13011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:51.497329 12992 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:51.497431 12992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "6cba05c665214c5193fc4422158a14e0"
format_stamp: "Formatted at 2026-08-10 01:45:51 on dist-test-slave-jlzn"
server_key: "5b851c1ad87d06a85b463b57efcd436d"
server_key_iv: "a230c96f703827a1072e526731b0908f"
server_key_version: "encryptionkey@0"
I20260810 01:45:51.497514 12992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:51.507085 12992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:51.507609 12992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:51.507752 12992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:51.508277 12992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:51.509104 12992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:51.509150 12992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:51.509186 12992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:51.509207 12992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:51.517222 12992 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:38935
I20260810 01:45:51.517287 13186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:38935 every 8 connection(s)
I20260810 01:45:51.518091 12992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:45:51.524664 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 12992
I20260810 01:45:51.524773 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:45:51.525054 16617 external_mini_cluster.cc:1428] Setting key 71af3630f2572c82716c117dc5e76947
I20260810 01:45:51.526914 12531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.519855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:54671 (local address 127.16.58.126:37069)
0810 01:45:51.519995 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.519999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.520966 (+ 967us) server_negotiation.cc:407] Connection header received
0810 01:45:51.522314 (+ 1348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.522318 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.522374 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.522447 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:51.523306 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.523914 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.525102 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.525362 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.525454 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.526462 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:51.526466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:51.526469 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:51.526482 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:51.526501 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:51.526509 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:51.526566 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.526714 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.526773 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:45:51.527665 13190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.520218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:37069 (local address 127.16.58.67:54671)
0810 01:45:51.520822 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:51.520862 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:51.522098 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:51.522621 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:51.522627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:51.522707 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:51.523165 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.523177 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.524030 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.524032 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.524988 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.524999 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.525507 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.525512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.525669 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.526218 (+ 549us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:45:51.526219 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:51.526258 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:45:51.526319 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:51.526581 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:51.526590 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:51.526596 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:45:51.526699 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 01:45:51.526954 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":109,"threads_started":1}
I20260810 01:45:51.528652 13187 heartbeater.cc:347] Connected to a master server at 127.16.58.126:37069
I20260810 01:45:51.528867 13187 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:51.529340 13187 heartbeater.cc:511] Master 127.16.58.126:37069 requested a full tablet report, sending...
I20260810 01:45:51.530313 12479 ts_manager.cc:194] Registered new tserver with Master: 6cba05c665214c5193fc4422158a14e0 (127.16.58.67:38935)
I20260810 01:45:51.530853 12479 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.67:54671
I20260810 01:45:51.538671 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:45:51.544024 12531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.540724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33272 (local address 127.16.58.126:37069)
0810 01:45:51.540875 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.540880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.540996 (+ 116us) server_negotiation.cc:407] Connection header received
0810 01:45:51.541109 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.541112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.541154 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.541216 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:51.541442 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.541923 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.542674 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.542865 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.542927 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.543616 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:51.543619 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:51.543621 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:51.543638 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:51.543656 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:51.543664 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:51.543761 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.543892 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.543922 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:45:51.546588 12479 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33272:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:45:51.549646 12479 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:45:51.563213 13207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.558542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46200 (local address 127.16.58.66:34069)
0810 01:45:51.559153 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.559165 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.559186 (+ 21us) server_negotiation.cc:407] Connection header received
0810 01:45:51.559247 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.559252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.559445 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.559604 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:51.559883 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.560725 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.561791 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.562573 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.562678 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.562855 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.562991 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.563080 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":161,"threads_started":1}
I20260810 01:45:51.563216 13203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.557855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34069 (local address 127.0.0.1:46200)
0810 01:45:51.558209 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:51.558254 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:51.558369 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:51.559614 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:51.559619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:51.559640 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:51.559766 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.559773 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.560817 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.560820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.561655 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.561664 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.562702 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.562706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.562815 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.562854 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 01:45:51.562963 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 01:45:51.563080 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":90,"threads_started":1}
I20260810 01:45:51.564162 13205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.557964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:38935 (local address 127.0.0.1:54978)
0810 01:45:51.558738 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:51.558752 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:51.558846 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:51.560467 (+ 1621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:51.560470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:51.560490 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:51.560569 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.560575 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.561874 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.561878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.562907 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.562916 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.563789 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.563793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.563899 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.563921 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:45:51.563983 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 01:45:51.564044 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":90,"threads_started":1}
I20260810 01:45:51.564252 13211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.558623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54978 (local address 127.16.58.67:38935)
0810 01:45:51.559346 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.559355 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.559373 (+ 18us) server_negotiation.cc:407] Connection header received
0810 01:45:51.559429 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.559432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.559611 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.560474 (+ 863us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:51.560684 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.561752 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.563043 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.563660 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.563762 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.563969 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.564015 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.564095 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":182,"threads_started":1}
I20260810 01:45:51.564867 13204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.558206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:39795 (local address 127.0.0.1:43166)
0810 01:45:51.559009 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:51.559021 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:51.559085 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:51.560262 (+ 1177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:51.560264 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:51.560281 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:51.560375 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.560382 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.561771 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.561775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.562878 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.562889 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.564505 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.564509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.564596 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.564616 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 01:45:51.564682 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 01:45:51.564748 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":1,"thread_start_us":107,"threads_started":1}
I20260810 01:45:51.565078 13209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.558636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43166 (local address 127.16.58.65:39795)
0810 01:45:51.559912 (+ 1276us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.559921 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.559940 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:45:51.560001 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.560005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.560127 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.560260 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:51.560496 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.561643 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.563420 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.564183 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.564281 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.564445 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.564740 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.564832 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1148,"thread_start_us":87,"threads_started":1}
I20260810 01:45:51.566672 12873 tablet_service.cc:1467] Processing CreateTablet for tablet df7c5f286a7640b9a8f1e06accb2040f (DEFAULT_TABLE table=test-table [id=9ffba48e38bb4bef9bba0df991f64c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:51.567085 13088 tablet_service.cc:1467] Processing CreateTablet for tablet df7c5f286a7640b9a8f1e06accb2040f (DEFAULT_TABLE table=test-table [id=9ffba48e38bb4bef9bba0df991f64c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:51.567646 12873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7c5f286a7640b9a8f1e06accb2040f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:51.567627 12664 tablet_service.cc:1467] Processing CreateTablet for tablet df7c5f286a7640b9a8f1e06accb2040f (DEFAULT_TABLE table=test-table [id=9ffba48e38bb4bef9bba0df991f64c5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:51.568126 13088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7c5f286a7640b9a8f1e06accb2040f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:51.568605 12664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7c5f286a7640b9a8f1e06accb2040f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:51.574555 13213 tablet_bootstrap.cc:492] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: Bootstrap starting.
I20260810 01:45:51.575295 13219 tablet_bootstrap.cc:492] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98: Bootstrap starting.
I20260810 01:45:51.575711 13217 tablet_bootstrap.cc:492] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: Bootstrap starting.
I20260810 01:45:51.576954 13213 tablet_bootstrap.cc:654] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:51.577513 13217 tablet_bootstrap.cc:654] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:51.577533 13219 tablet_bootstrap.cc:654] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:51.577876 13213 log.cc:824] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:51.578217 13217 log.cc:824] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:51.578320 13219 log.cc:824] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:51.580094 13213 tablet_bootstrap.cc:492] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: No bootstrap required, opened a new log
I20260810 01:45:51.580216 13217 tablet_bootstrap.cc:492] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: No bootstrap required, opened a new log
I20260810 01:45:51.580216 13219 tablet_bootstrap.cc:492] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98: No bootstrap required, opened a new log
I20260810 01:45:51.580340 13213 ts_tablet_manager.cc:1397] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 01:45:51.580405 13217 ts_tablet_manager.cc:1397] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:45:51.580405 13219 ts_tablet_manager.cc:1397] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:45:51.583437 13213 raft_consensus.cc:348] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } }
I20260810 01:45:51.583664 13213 raft_consensus.cc:374] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:51.583739 13213 raft_consensus.cc:729] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ffd6fba244646f8b147d9b8efeb126a, State: Initialized, Role: FOLLOWER
I20260810 01:45:51.584208 13213 consensus_queue.cc:260] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } }
I20260810 01:45:51.584518 13219 raft_consensus.cc:348] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } }
I20260810 01:45:51.584518 13217 raft_consensus.cc:348] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } }
I20260810 01:45:51.584764 13217 raft_consensus.cc:374] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:51.584820 12984 heartbeater.cc:503] Master 127.16.58.126:37069 was elected leader, sending a full tablet report...
I20260810 01:45:51.584827 13219 raft_consensus.cc:374] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:51.584887 13219 raft_consensus.cc:729] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3f4a70fc3b34d3ca9e95816d6edba98, State: Initialized, Role: FOLLOWER
I20260810 01:45:51.584867 13217 raft_consensus.cc:729] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cba05c665214c5193fc4422158a14e0, State: Initialized, Role: FOLLOWER
I20260810 01:45:51.585242 13213 ts_tablet_manager.cc:1428] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:45:51.585361 13217 consensus_queue.cc:260] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } }
I20260810 01:45:51.585361 13219 consensus_queue.cc:260] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } }
I20260810 01:45:51.586233 13187 heartbeater.cc:503] Master 127.16.58.126:37069 was elected leader, sending a full tablet report...
I20260810 01:45:51.586294 13219 ts_tablet_manager.cc:1428] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:45:51.586294 13217 ts_tablet_manager.cc:1428] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:45:51.587347 12756 heartbeater.cc:503] Master 127.16.58.126:37069 was elected leader, sending a full tablet report...
W20260810 01:45:51.588198 12988 tablet.cc:2369] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:45:51.660259 12757 tablet.cc:2369] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:45:51.689823 13231 raft_consensus.cc:482] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:51.690022 13231 raft_consensus.cc:504] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } }
I20260810 01:45:51.691148 13231 leader_election.cc:288] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ffd6fba244646f8b147d9b8efeb126a (127.16.58.66:34069), b3f4a70fc3b34d3ca9e95816d6edba98 (127.16.58.65:39795)
I20260810 01:45:51.695410 13190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.691359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:39795 (local address 127.16.58.67:53183)
0810 01:45:51.691516 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:51.691532 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:51.691629 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:51.691897 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:51.691900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:51.691923 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:51.692052 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.692059 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.693019 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.693021 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.694191 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.694201 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.695019 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.695022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.695107 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.695134 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 01:45:51.695207 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 01:45:51.695274 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 01:45:51.695436 13209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.691480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:53183 (local address 127.16.58.65:39795)
0810 01:45:51.691619 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.691624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.691641 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:45:51.691707 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.691710 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.691764 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.691882 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:51.692179 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.692909 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.694321 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.694903 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.695023 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.695076 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.695238 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.695305 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:45:51.695502 13207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.691615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:53165 (local address 127.16.58.66:34069)
0810 01:45:51.691758 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.691761 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.692129 (+ 368us) server_negotiation.cc:407] Connection header received
0810 01:45:51.692217 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.692220 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.692268 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.692338 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:51.692561 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.693181 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.694494 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.695030 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.695141 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.695173 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.695338 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.695402 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 01:45:51.695509 13232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.691359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:34069 (local address 127.16.58.67:53165)
0810 01:45:51.692012 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:51.692026 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:51.692137 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:51.692354 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:51.692355 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:51.692369 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:51.692462 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.692466 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.693278 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.693282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.694364 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:51.694371 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.695140 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.695143 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:51.695226 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.695247 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 01:45:51.695307 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 01:45:51.695360 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"mutex_wait_us":316,"thread_start_us":164,"threads_started":1}
I20260810 01:45:51.696195 12692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7c5f286a7640b9a8f1e06accb2040f" candidate_uuid: "6cba05c665214c5193fc4422158a14e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" is_pre_election: true
I20260810 01:45:51.696374 12901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7c5f286a7640b9a8f1e06accb2040f" candidate_uuid: "6cba05c665214c5193fc4422158a14e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffd6fba244646f8b147d9b8efeb126a" is_pre_election: true
I20260810 01:45:51.696475 12692 raft_consensus.cc:2454] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cba05c665214c5193fc4422158a14e0 in term 0.
I20260810 01:45:51.696638 12901 raft_consensus.cc:2454] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cba05c665214c5193fc4422158a14e0 in term 0.
I20260810 01:45:51.696998 13015 leader_election.cc:302] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cba05c665214c5193fc4422158a14e0, b3f4a70fc3b34d3ca9e95816d6edba98; no voters:
I20260810 01:45:51.697286 13231 raft_consensus.cc:2781] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:45:51.697363 13231 raft_consensus.cc:482] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:45:51.697394 13231 raft_consensus.cc:3037] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:51.698383 13231 raft_consensus.cc:504] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } }
I20260810 01:45:51.698702 13231 leader_election.cc:288] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [CANDIDATE]: Term 1 election: Requested vote from peers 5ffd6fba244646f8b147d9b8efeb126a (127.16.58.66:34069), b3f4a70fc3b34d3ca9e95816d6edba98 (127.16.58.65:39795)
I20260810 01:45:51.698995 12901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7c5f286a7640b9a8f1e06accb2040f" candidate_uuid: "6cba05c665214c5193fc4422158a14e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ffd6fba244646f8b147d9b8efeb126a"
I20260810 01:45:51.699110 12901 raft_consensus.cc:3037] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:51.699970 12692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7c5f286a7640b9a8f1e06accb2040f" candidate_uuid: "6cba05c665214c5193fc4422158a14e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98"
I20260810 01:45:51.700078 12692 raft_consensus.cc:3037] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:51.700235 12901 raft_consensus.cc:2454] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cba05c665214c5193fc4422158a14e0 in term 1.
I20260810 01:45:51.700536 13014 leader_election.cc:302] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ffd6fba244646f8b147d9b8efeb126a, 6cba05c665214c5193fc4422158a14e0; no voters:
I20260810 01:45:51.700703 13231 raft_consensus.cc:2781] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:51.700888 13231 raft_consensus.cc:686] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 1 LEADER]: Becoming Leader. State: Replica: 6cba05c665214c5193fc4422158a14e0, State: Running, Role: LEADER
I20260810 01:45:51.701241 12692 raft_consensus.cc:2454] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cba05c665214c5193fc4422158a14e0 in term 1.
I20260810 01:45:51.701222 13231 consensus_queue.cc:237] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } }
I20260810 01:45:51.704326 12473 catalog_manager.cc:5495] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cba05c665214c5193fc4422158a14e0 (127.16.58.67). New cstate: current_term: 1 leader_uuid: "6cba05c665214c5193fc4422158a14e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cba05c665214c5193fc4422158a14e0" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 38935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 } health_report { overall_health: UNKNOWN } } }
I20260810 01:45:51.752144 13211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.748475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53484 (local address 127.16.58.67:38935)
0810 01:45:51.748612 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:51.748615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:51.748628 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:45:51.748724 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:51.748728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:51.748790 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:51.748877 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:45:51.749099 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.749601 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.750513 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:51.750755 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:51.750848 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:51.751177 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:45:51.751654 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:45:51.751794 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:51.751953 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 01:45:51.751990 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:45:51.758002 12901 raft_consensus.cc:1261] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [term 1 FOLLOWER]: Refusing update from remote peer 6cba05c665214c5193fc4422158a14e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:51.758002 12692 raft_consensus.cc:1261] T df7c5f286a7640b9a8f1e06accb2040f P b3f4a70fc3b34d3ca9e95816d6edba98 [term 1 FOLLOWER]: Refusing update from remote peer 6cba05c665214c5193fc4422158a14e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:51.758729 13233 consensus_queue.cc:1035] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ffd6fba244646f8b147d9b8efeb126a" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:51.758914 13231 consensus_queue.cc:1035] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3f4a70fc3b34d3ca9e95816d6edba98" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 39795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:51.767112 13242 mvcc.cc:205] Tried to move back new op lower bound from 7316792736793427968 to 7316792736571027456. Current Snapshot: MvccSnapshot[applied={T|T < 7316792736793427968}]
I20260810 01:45:51.767647 13243 mvcc.cc:205] Tried to move back new op lower bound from 7316792736793427968 to 7316792736571027456. Current Snapshot: MvccSnapshot[applied={T|T < 7316792736793427968}]
I20260810 01:45:51.774904 12473 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:51.775067 12473 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33272:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:51.777534 12473 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b5864475b5964a09b9f6751212f26580: Sending DeleteTablet for 3 replicas of tablet df7c5f286a7640b9a8f1e06accb2040f
I20260810 01:45:51.778291 13088 tablet_service.cc:1514] Processing DeleteTablet for tablet df7c5f286a7640b9a8f1e06accb2040f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:51 UTC) from {username='slave'} at 127.0.0.1:54978
I20260810 01:45:51.778302 12873 tablet_service.cc:1514] Processing DeleteTablet for tablet df7c5f286a7640b9a8f1e06accb2040f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:51 UTC) from {username='slave'} at 127.0.0.1:46200
I20260810 01:45:51.778345 12664 tablet_service.cc:1514] Processing DeleteTablet for tablet df7c5f286a7640b9a8f1e06accb2040f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:51 UTC) from {username='slave'} at 127.0.0.1:43166
I20260810 01:45:51.778815 13251 tablet_replica.cc:330] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: stopping tablet replica
I20260810 01:45:51.779122 13251 raft_consensus.cc:2229] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:51.779441 13251 raft_consensus.cc:2258] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:51.779495 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 12562
I20260810 01:45:51.792135 13252 tablet_replica.cc:330] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: stopping tablet replica
I20260810 01:45:51.792459 13252 raft_consensus.cc:2229] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:45:51.792876 13252 raft_consensus.cc:2258] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:51.793732 13251 ts_tablet_manager.cc:1905] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:51.794087 13252 ts_tablet_manager.cc:1905] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:51.796836 13252 ts_tablet_manager.cc:1918] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:51.796931 13252 log.cc:1196] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/df7c5f286a7640b9a8f1e06accb2040f
I20260810 01:45:51.796886 13251 ts_tablet_manager.cc:1918] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:51.797196 13251 log.cc:1196] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/df7c5f286a7640b9a8f1e06accb2040f
I20260810 01:45:51.797240 13252 ts_tablet_manager.cc:1939] T df7c5f286a7640b9a8f1e06accb2040f P 6cba05c665214c5193fc4422158a14e0: Deleting consensus metadata
I20260810 01:45:51.797567 13251 ts_tablet_manager.cc:1939] T df7c5f286a7640b9a8f1e06accb2040f P 5ffd6fba244646f8b147d9b8efeb126a: Deleting consensus metadata
I20260810 01:45:51.798401 12459 catalog_manager.cc:4841] TS 6cba05c665214c5193fc4422158a14e0 (127.16.58.67:38935): tablet df7c5f286a7640b9a8f1e06accb2040f (table test-table [id=9ffba48e38bb4bef9bba0df991f64c5a]) successfully deleted
I20260810 01:45:51.798888 12460 catalog_manager.cc:4841] TS 5ffd6fba244646f8b147d9b8efeb126a (127.16.58.66:34069): tablet df7c5f286a7640b9a8f1e06accb2040f (table test-table [id=9ffba48e38bb4bef9bba0df991f64c5a]) successfully deleted
W20260810 01:45:51.799077 12461 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:39795 (error 108)
I20260810 01:45:51.799873 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 12762
I20260810 01:45:51.800113 13204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:51.799839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:39795 (local address 127.0.0.1:34154)
0810 01:45:51.799951 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:51.800029 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:39795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 01:45:51.826822 12461 catalog_manager.cc:4584] TS b3f4a70fc3b34d3ca9e95816d6edba98 (127.16.58.65:39795): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet df7c5f286a7640b9a8f1e06accb2040f: Network error: Client connection negotiation failed: client connection to 127.16.58.65:39795: connect: Connection refused (error 111)
I20260810 01:45:51.834090 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 12992
I20260810 01:45:51.849831 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 12435
2026-08-10T01:45:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1138 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:45:51 dist-test-slave-jlzn krb5kdc[13258](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:45:51 dist-test-slave-jlzn krb5kdc[13258](info): set up 2 sockets
Aug 10 01:45:51 dist-test-slave-jlzn krb5kdc[13258](info): commencing operation
krb5kdc: starting...
W20260810 01:45:52.974622 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:45:53 dist-test-slave-jlzn krb5kdc[13258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:45:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:45:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:45:53.092597 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:34607
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:34607
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:53.203100 13279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:53.203347 13279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:53.203405 13279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:53.207317 13279 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:53.207373 13279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:53.207401 13279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:53.207420 13279 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:53.207448 13279 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:53.212591 13279 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:34607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:34607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13279
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:53.213590 13279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:53.214565 13279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:53.222869 13288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:53.222838 13286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:53.222846 13291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:53.223191 13279 server_base.cc:1034] running on GCE node
I20260810 01:45:53.223779 13279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:53.224864 13279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:53.226040 13279 hybrid_clock.cc:648] HybridClock initialized: now 1786326353226023 us; error 27 us; skew 500 ppm
Aug 10 01:45:53 dist-test-slave-jlzn krb5kdc[13258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326353, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:53.228675 13279 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:45:53.229537 13279 webserver.cc:460] Webserver started at http://127.16.58.126:35057/ using document root <none> and password file <none>
I20260810 01:45:53.230055 13279 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:53.230122 13279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:53.230314 13279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:53.232354 13279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "7bd3034b251946c6954c4913ba69eff5"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "e2dfa1c2fda8cbb75c01014e0987cf18"
server_key_iv: "399369c7a3cf1e46a8fb442f8bc6df3e"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.232897 13279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "7bd3034b251946c6954c4913ba69eff5"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "e2dfa1c2fda8cbb75c01014e0987cf18"
server_key_iv: "399369c7a3cf1e46a8fb442f8bc6df3e"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.236424 13279 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:45:53.238673 13301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:53.239842 13279 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:45:53.239967 13279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "7bd3034b251946c6954c4913ba69eff5"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "e2dfa1c2fda8cbb75c01014e0987cf18"
server_key_iv: "399369c7a3cf1e46a8fb442f8bc6df3e"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.240063 13279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:53.251055 13279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:53.253638 13279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:53.253808 13279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:53.260865 13279 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:34607
I20260810 01:45:53.260891 13377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:34607 every 8 connection(s)
I20260810 01:45:53.261749 13279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:53.264402 13379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:53.268090 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 13279
I20260810 01:45:53.268235 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:45:53.268532 16617 external_mini_cluster.cc:1428] Setting key c8f58be8d782e19d762b2b6423ade532
I20260810 01:45:53.270104 13379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5: Bootstrap starting.
I20260810 01:45:53.272497 13379 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:53.273204 13379 log.cc:824] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:53.274936 13379 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5: No bootstrap required, opened a new log
Aug 10 01:45:53 dist-test-slave-jlzn krb5kdc[13258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:53.278939 13379 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd3034b251946c6954c4913ba69eff5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34607 } }
I20260810 01:45:53.279156 13379 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:53.279191 13379 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd3034b251946c6954c4913ba69eff5, State: Initialized, Role: FOLLOWER
I20260810 01:45:53.279584 13379 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd3034b251946c6954c4913ba69eff5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34607 } }
I20260810 01:45:53.279752 13379 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:53.279841 13379 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:53.279946 13379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:53.280866 13379 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd3034b251946c6954c4913ba69eff5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34607 } }
I20260810 01:45:53.281229 13379 leader_election.cc:302] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bd3034b251946c6954c4913ba69eff5; no voters:
I20260810 01:45:53.281553 13379 leader_election.cc:288] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:45:53.281658 13385 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:53.282574 13382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:53.269833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54972 (local address 127.16.58.126:34607)
0810 01:45:53.270251 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:53.270271 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:53.270310 (+ 39us) server_negotiation.cc:407] Connection header received
0810 01:45:53.270958 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:53.270975 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:53.271285 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:53.271682 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:53.272482 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.273591 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.274447 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.274935 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.275081 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:53.277748 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:53.277753 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:53.277765 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:53.277791 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:53.279506 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:53.280002 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:53.280008 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:53.280014 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:53.280148 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:53.280432 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:53.280435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:53.280436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:53.280814 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:53.280958 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:53.281272 (+ 314us) server_negotiation.cc:299] Negotiation successful
0810 01:45:53.281550 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":125,"threads_started":1}
I20260810 01:45:53.282780 13379 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:53.281834 13385 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [term 1 LEADER]: Becoming Leader. State: Replica: 7bd3034b251946c6954c4913ba69eff5, State: Running, Role: LEADER
I20260810 01:45:53.284096 13385 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd3034b251946c6954c4913ba69eff5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34607 } }
I20260810 01:45:53.285718 13387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bd3034b251946c6954c4913ba69eff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd3034b251946c6954c4913ba69eff5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34607 } } }
I20260810 01:45:53.285758 13389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bd3034b251946c6954c4913ba69eff5. Latest consensus state: current_term: 1 leader_uuid: "7bd3034b251946c6954c4913ba69eff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bd3034b251946c6954c4913ba69eff5" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34607 } } }
I20260810 01:45:53.285843 13387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:53.285856 13389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5 [sys.catalog]: This master's current role is: LEADER
W20260810 01:45:53.288472 13408 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:45:53.288553 13408 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:45:53.288625 13409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:53.289458 13409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:53.294631 13409 catalog_manager.cc:1347] Generated new cluster ID: 360051acdfae43e2b41b29d133a36aed
I20260810 01:45:53.294683 13409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:53.318388 13409 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:45:53.319271 13409 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:53.327309 13409 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5: Generated new TSK 0
I20260810 01:45:53.327956 13409 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.16.58.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
Entry for principal kudu/127.16.58.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab.
I20260810 01:45:53.362754 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34607
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:53.491565 13416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:53.491794 13416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:53.491874 13416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:53.495730 13416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:53.495780 13416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:53.495882 13416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:45:53.500851 13416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.65.keytab
--principal=kudu/127.16.58.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:53.501748 13416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:53.502663 13416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:53.511746 13423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:53.511850 13416 server_base.cc:1034] running on GCE node
W20260810 01:45:53.511758 13426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:53.511754 13424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:53.512279 13416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:53.512861 13416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:53.514026 13416 hybrid_clock.cc:648] HybridClock initialized: now 1786326353514009 us; error 27 us; skew 500 ppm
Aug 10 01:45:53 dist-test-slave-jlzn krb5kdc[13258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326353, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:53.516636 13416 init.cc:377] Logged in from keytab as kudu/127.16.58.65@KRBTEST.COM (short username kudu)
I20260810 01:45:53.517432 13416 webserver.cc:460] Webserver started at http://127.16.58.65:41683/ using document root <none> and password file <none>
I20260810 01:45:53.517942 13416 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:53.518005 13416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:53.518213 13416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:53.520200 13416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "b37ccf1315f043e4afa4d0a3e00a22bc"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "f275781af42433d868f25fb1ee44a499"
server_key_iv: "87daefeef3d9cc407066fa15a9834369"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.520720 13416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "b37ccf1315f043e4afa4d0a3e00a22bc"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "f275781af42433d868f25fb1ee44a499"
server_key_iv: "87daefeef3d9cc407066fa15a9834369"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.524200 13416 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:45:53.526427 13441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:53.527527 13416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:53.527647 13416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "b37ccf1315f043e4afa4d0a3e00a22bc"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "f275781af42433d868f25fb1ee44a499"
server_key_iv: "87daefeef3d9cc407066fa15a9834369"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.527740 13416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:53.558256 13416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:53.561542 13416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:53.561731 13416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:53.562336 13416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:53.563208 13416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:53.563258 13416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:53.563315 13416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:53.563344 13416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:53.571991 13416 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:43045
I20260810 01:45:53.572034 13606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:43045 every 8 connection(s)
I20260810 01:45:53.572868 13416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:45:53.579186 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 13416
I20260810 01:45:53.579290 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:45:53.579555 16617 external_mini_cluster.cc:1428] Setting key d85f5230de0e19f242d8759bc46e8eb3
Aug 10 01:45:53 dist-test-slave-jlzn krb5kdc[13258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326353, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.65@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:53.586193 13382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:53.574661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:45723 (local address 127.16.58.126:34607)
0810 01:45:53.574789 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:53.574793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:53.575607 (+ 814us) server_negotiation.cc:407] Connection header received
0810 01:45:53.576924 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:53.576928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:53.576985 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:53.577072 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:53.578232 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.578766 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.580023 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.580260 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.580354 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:53.582709 (+ 2355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:53.582712 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:53.582715 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:53.582740 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:53.584211 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:53.584693 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:53.584696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:53.584698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:53.584783 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:53.585146 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:53.585149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:53.585151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:53.585328 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:53.585414 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:53.585904 (+ 490us) server_negotiation.cc:299] Negotiation successful
0810 01:45:53.586034 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:45:53.586916 13609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:53.575003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34607 (local address 127.16.58.65:45723)
0810 01:45:53.575437 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:53.575478 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:53.576704 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:53.577258 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:53.577264 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:53.577619 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:53.578073 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:53.578086 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.578894 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.578897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:53.579898 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:53.579910 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.580405 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.580410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:53.580588 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:53.581129 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:53.581146 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:53.582552 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:53.584315 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:53.584321 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:53.584334 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:53.584594 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:53.584870 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:53.584873 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:53.584875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:53.585055 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:53.585433 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:53.585439 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:53.585676 (+ 237us) client_negotiation.cc:769] Sending connection context
0810 01:45:53.585834 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 01:45:53.586132 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":129,"threads_started":1}
I20260810 01:45:53.588109 13607 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34607
I20260810 01:45:53.588358 13607 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:53.588902 13607 heartbeater.cc:511] Master 127.16.58.126:34607 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.58.66@KRBTEST.COM; defaulting to no policy
I20260810 01:45:53.590476 13324 ts_manager.cc:194] Registered new tserver with Master: b37ccf1315f043e4afa4d0a3e00a22bc (127.16.58.65:43045)
I20260810 01:45:53.591677 13324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.65@KRBTEST.COM'} at 127.16.58.65:45723
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
Entry for principal kudu/127.16.58.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab.
I20260810 01:45:53.606775 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34607
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:53.714582 13615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:53.714824 13615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:53.714867 13615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:53.718766 13615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:53.718817 13615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:53.718884 13615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:45:53.723963 13615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.66.keytab
--principal=kudu/127.16.58.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:53.724913 13615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:53.725884 13615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:53.735368 13626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:53.735462 13615 server_base.cc:1034] running on GCE node
W20260810 01:45:53.735349 13628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:53.735349 13625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:53.736155 13615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:53.736727 13615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:53.737881 13615 hybrid_clock.cc:648] HybridClock initialized: now 1786326353737860 us; error 31 us; skew 500 ppm
Aug 10 01:45:53 dist-test-slave-jlzn krb5kdc[13258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326353, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:53.740492 13615 init.cc:377] Logged in from keytab as kudu/127.16.58.66@KRBTEST.COM (short username kudu)
I20260810 01:45:53.741321 13615 webserver.cc:460] Webserver started at http://127.16.58.66:36997/ using document root <none> and password file <none>
I20260810 01:45:53.741837 13615 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:53.741899 13615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:53.742090 13615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:53.744179 13615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "1218f7f0532945348f0d0cf7443e05b4"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "2f72c2aac24b94665ad60dc9222cc52a"
server_key_iv: "608f8451ba91232d6daa74eeb6a09fb4"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.744736 13615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "1218f7f0532945348f0d0cf7443e05b4"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "2f72c2aac24b94665ad60dc9222cc52a"
server_key_iv: "608f8451ba91232d6daa74eeb6a09fb4"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.748286 13615 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:45:53.750542 13639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:53.751765 13615 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:53.751933 13615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "1218f7f0532945348f0d0cf7443e05b4"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "2f72c2aac24b94665ad60dc9222cc52a"
server_key_iv: "608f8451ba91232d6daa74eeb6a09fb4"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.752058 13615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:53.793164 13615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:53.795822 13615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:53.795996 13615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:53.796561 13615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:53.797363 13615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:53.797410 13615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:53.797465 13615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:53.797495 13615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:53.805713 13615 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:38271
I20260810 01:45:53.805742 13808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:38271 every 8 connection(s)
I20260810 01:45:53.806506 13615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:45:53.812381 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 13615
I20260810 01:45:53.812515 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:45:53.812814 16617 external_mini_cluster.cc:1428] Setting key 0558e880e861be4c70fc27e30806ef00
Aug 10 01:45:53 dist-test-slave-jlzn krb5kdc[13258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326353, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.66@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:53.819543 13382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:53.808182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:56483 (local address 127.16.58.126:34607)
0810 01:45:53.808345 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:53.808350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:53.809125 (+ 775us) server_negotiation.cc:407] Connection header received
0810 01:45:53.810320 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:53.810323 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:53.810369 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:53.810440 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:53.811482 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.812070 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.813535 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.813820 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.813919 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:53.816367 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:53.816371 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:53.816374 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:53.816403 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:53.817589 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:53.818074 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:53.818077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:53.818079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:53.818160 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:53.818483 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:53.818486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:53.818488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:53.818673 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:53.818758 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:53.819262 (+ 504us) server_negotiation.cc:299] Negotiation successful
0810 01:45:53.819384 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 01:45:53.820377 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:53.808533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34607 (local address 127.16.58.66:56483)
0810 01:45:53.808974 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:53.809014 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:53.810134 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:53.810585 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:53.810591 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:53.810924 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:53.811367 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:53.811381 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.812185 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.812189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:53.813418 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:53.813430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:53.813953 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:53.813956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:53.814137 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:53.814670 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:53.814690 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:53.816184 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:53.817715 (+ 1531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:53.817721 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:53.817734 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:53.817974 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:53.818250 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:53.818253 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:53.818255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:53.818388 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:53.818780 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:53.818787 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:53.819001 (+ 214us) client_negotiation.cc:769] Sending connection context
0810 01:45:53.819198 (+ 197us) client_negotiation.cc:240] Negotiation successful
0810 01:45:53.819497 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":123,"threads_started":1}
I20260810 01:45:53.821573 13809 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34607
I20260810 01:45:53.821810 13809 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:53.822254 13809 heartbeater.cc:511] Master 127.16.58.126:34607 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.16.58.67@KRBTEST.COM; defaulting to no policy
I20260810 01:45:53.823333 13324 ts_manager.cc:194] Registered new tserver with Master: 1218f7f0532945348f0d0cf7443e05b4 (127.16.58.66:38271)
I20260810 01:45:53.823968 13324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.66@KRBTEST.COM'} at 127.16.58.66:56483
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
Entry for principal kudu/127.16.58.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab.
I20260810 01:45:53.839946 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34607
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:53.948096 13816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:53.948342 13816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:53.948383 13816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:53.952262 13816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:53.952315 13816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:53.952370 13816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:45:53.957490 13816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.67.keytab
--principal=kudu/127.16.58.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:53.958429 13816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:53.959368 13816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:45:53.969019 13816 server_base.cc:1034] running on GCE node
W20260810 01:45:53.968968 13825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:53.968973 13831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:53.968984 13828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:53.969594 13816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:53.970201 13816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:53.971364 13816 hybrid_clock.cc:648] HybridClock initialized: now 1786326353971341 us; error 33 us; skew 500 ppm
Aug 10 01:45:53 dist-test-slave-jlzn krb5kdc[13258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326353, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:53.974004 13816 init.cc:377] Logged in from keytab as kudu/127.16.58.67@KRBTEST.COM (short username kudu)
I20260810 01:45:53.974860 13816 webserver.cc:460] Webserver started at http://127.16.58.67:38131/ using document root <none> and password file <none>
I20260810 01:45:53.975394 13816 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:53.975461 13816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:53.975651 13816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:53.977633 13816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "0c9f18dd574c45449bc98d7e5ecb32b6"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "73c1ee502a185400185c1184f3112d8c"
server_key_iv: "b5d36d1cf305e09722865d8609817261"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.978168 13816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "0c9f18dd574c45449bc98d7e5ecb32b6"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "73c1ee502a185400185c1184f3112d8c"
server_key_iv: "b5d36d1cf305e09722865d8609817261"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.981657 13816 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 01:45:53.984059 13840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:53.985253 13816 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:45:53.985357 13816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "0c9f18dd574c45449bc98d7e5ecb32b6"
format_stamp: "Formatted at 2026-08-10 01:45:53 on dist-test-slave-jlzn"
server_key: "73c1ee502a185400185c1184f3112d8c"
server_key_iv: "b5d36d1cf305e09722865d8609817261"
server_key_version: "encryptionkey@0"
I20260810 01:45:53.985446 13816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:54.002705 13816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:54.005370 13816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:54.005543 13816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:54.006117 13816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:54.006922 13816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:54.006969 13816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:54.007020 13816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:54.007050 13816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:54.015415 13816 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:40939
I20260810 01:45:54.015461 14017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:40939 every 8 connection(s)
I20260810 01:45:54.016311 13816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
Aug 10 01:45:54 dist-test-slave-jlzn krb5kdc[13258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326353, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.67@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:45:54.025540 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 13816
I20260810 01:45:54.025676 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:45:54.026023 16617 external_mini_cluster.cc:1428] Setting key 59ebc47a00327e2a32763baed93b07a6
I20260810 01:45:54.029337 13382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.017990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:41083 (local address 127.16.58.126:34607)
0810 01:45:54.018143 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:54.018148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:54.018924 (+ 776us) server_negotiation.cc:407] Connection header received
0810 01:45:54.020429 (+ 1505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:54.020432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:54.020481 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:54.020556 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:54.021659 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.022184 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.023238 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.023443 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.023511 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.025833 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:54.025837 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:54.025840 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:54.025870 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:54.027403 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:54.027971 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:54.027973 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:54.027975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:54.028049 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:54.028409 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:54.028412 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:54.028413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:54.028592 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:54.028669 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:54.029112 (+ 443us) server_negotiation.cc:299] Negotiation successful
0810 01:45:54.029219 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:45:54.030066 14023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.018348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34607 (local address 127.16.58.67:41083)
0810 01:45:54.018776 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:54.018818 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:54.020228 (+ 1410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:54.020710 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:54.020717 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:54.021049 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:54.021513 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.021527 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.022277 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.022279 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.023147 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.023155 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.023551 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.023553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.023687 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.024269 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:45:54.024285 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:54.025665 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:54.027496 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:54.027501 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:54.027514 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:54.027888 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:54.028139 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:45:54.028142 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:45:54.028144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:45:54.028311 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:45:54.028672 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:54.028676 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:54.028901 (+ 225us) client_negotiation.cc:769] Sending connection context
0810 01:45:54.029056 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 01:45:54.029310 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":109,"threads_started":1}
I20260810 01:45:54.031157 14021 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34607
I20260810 01:45:54.031374 14021 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:54.031877 14021 heartbeater.cc:511] Master 127.16.58.126:34607 requested a full tablet report, sending...
I20260810 01:45:54.032827 13324 ts_manager.cc:194] Registered new tserver with Master: 0c9f18dd574c45449bc98d7e5ecb32b6 (127.16.58.67:40939)
I20260810 01:45:54.033356 13324 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.16.58.67@KRBTEST.COM'} at 127.16.58.67:41083
I20260810 01:45:54.039749 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:45:54.048410 13382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.041640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54980 (local address 127.16.58.126:34607)
0810 01:45:54.041776 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:54.041780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:54.041921 (+ 141us) server_negotiation.cc:407] Connection header received
0810 01:45:54.042033 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:54.042036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:54.042078 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:54.042151 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:54.042801 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.043338 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.044302 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.044530 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.044617 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.045813 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:54.045816 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:54.045819 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:54.045843 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:54.046839 (+ 996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:54.047235 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:54.047239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:54.047241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:54.047316 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:54.047565 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:54.047569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:54.047570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:54.047780 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:54.047935 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:54.048159 (+ 224us) server_negotiation.cc:299] Negotiation successful
0810 01:45:54.048263 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:45:54.050894 13324 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:45:54.053923 13324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:45:54.067342 14035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.061926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35698 (local address 127.16.58.65:43045)
0810 01:45:54.062671 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:54.062686 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:54.062705 (+ 19us) server_negotiation.cc:407] Connection header received
0810 01:45:54.062777 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:54.062782 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:54.062987 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:54.063133 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:54.063450 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.064585 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.065987 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.066687 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.066785 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.066935 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:54.067116 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 01:45:54.067210 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":103,"threads_started":1}
I20260810 01:45:54.067332 14034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.061757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:43045 (local address 127.0.0.1:35698)
0810 01:45:54.062077 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:54.062121 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:54.062239 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:54.063143 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:54.063149 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:54.063171 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:54.063295 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.063302 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.064733 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.064736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.065853 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.065863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.066806 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.066810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.066917 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.066954 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 01:45:54.067058 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 01:45:54.067186 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":67,"threads_started":1}
I20260810 01:45:54.068068 14037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.062464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:40939 (local address 127.0.0.1:60466)
0810 01:45:54.063236 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:54.063248 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:54.063327 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:54.063857 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:54.063860 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:54.063879 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:54.063976 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.063983 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.064993 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.064997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.066106 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.066117 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.067325 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.067329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.067751 (+ 422us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.067777 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:45:54.067867 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 01:45:54.067937 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":91,"threads_started":1}
I20260810 01:45:54.068281 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.062870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60466 (local address 127.16.58.67:40939)
0810 01:45:54.063473 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:54.063484 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:54.063504 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:45:54.063564 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:54.063568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:54.063706 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:54.063867 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:54.064098 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.064850 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.066241 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.067048 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.067139 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.067264 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:54.068045 (+ 781us) server_negotiation.cc:299] Negotiation successful
0810 01:45:54.068151 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":142,"threads_started":1}
I20260810 01:45:54.068229 14036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.062094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:38271 (local address 127.0.0.1:45764)
0810 01:45:54.062465 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:54.062477 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:54.062558 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:54.063996 (+ 1438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:54.063999 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:54.064018 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:54.064104 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.064110 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.065550 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.065553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.066766 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.066777 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.067844 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.067848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.067947 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.067971 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 01:45:54.068040 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 01:45:54.068105 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":91,"threads_started":1}
I20260810 01:45:54.068531 14038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.062885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45764 (local address 127.16.58.66:38271)
0810 01:45:54.063528 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:54.063538 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:54.063561 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:45:54.063631 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:54.063636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:54.063845 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:54.064257 (+ 412us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:54.064403 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.065388 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.066905 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.067687 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.067792 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.067960 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:54.068326 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 01:45:54.068416 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":91,"threads_started":1}
I20260810 01:45:54.070377 13513 tablet_service.cc:1467] Processing CreateTablet for tablet dab5b7e818804f8fa6a615f14098e80a (DEFAULT_TABLE table=test-table [id=34d97fb16c7a44aeb8eabb64450395f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:54.070824 13706 tablet_service.cc:1467] Processing CreateTablet for tablet dab5b7e818804f8fa6a615f14098e80a (DEFAULT_TABLE table=test-table [id=34d97fb16c7a44aeb8eabb64450395f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:54.071278 13513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab5b7e818804f8fa6a615f14098e80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:54.071630 13706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab5b7e818804f8fa6a615f14098e80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:54.074635 13910 tablet_service.cc:1467] Processing CreateTablet for tablet dab5b7e818804f8fa6a615f14098e80a (DEFAULT_TABLE table=test-table [id=34d97fb16c7a44aeb8eabb64450395f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:54.075682 13910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab5b7e818804f8fa6a615f14098e80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:54.078187 14046 tablet_bootstrap.cc:492] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc: Bootstrap starting.
I20260810 01:45:54.078855 14047 tablet_bootstrap.cc:492] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: Bootstrap starting.
I20260810 01:45:54.080497 14046 tablet_bootstrap.cc:654] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:54.081426 14047 tablet_bootstrap.cc:654] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:54.081832 14046 log.cc:824] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:54.082494 14047 log.cc:824] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:54.082600 14048 tablet_bootstrap.cc:492] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: Bootstrap starting.
I20260810 01:45:54.084030 14046 tablet_bootstrap.cc:492] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc: No bootstrap required, opened a new log
I20260810 01:45:54.084228 14046 ts_tablet_manager.cc:1397] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260810 01:45:54.084533 14047 tablet_bootstrap.cc:492] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: No bootstrap required, opened a new log
I20260810 01:45:54.084770 14047 ts_tablet_manager.cc:1397] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260810 01:45:54.084825 14048 tablet_bootstrap.cc:654] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:54.085981 14048 log.cc:824] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:54.087280 14046 raft_consensus.cc:348] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } }
I20260810 01:45:54.087566 14046 raft_consensus.cc:374] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:54.087636 14046 raft_consensus.cc:729] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b37ccf1315f043e4afa4d0a3e00a22bc, State: Initialized, Role: FOLLOWER
I20260810 01:45:54.087956 14048 tablet_bootstrap.cc:492] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: No bootstrap required, opened a new log
I20260810 01:45:54.088145 14048 ts_tablet_manager.cc:1397] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 01:45:54.088135 14046 consensus_queue.cc:260] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } }
I20260810 01:45:54.088166 14047 raft_consensus.cc:348] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } }
I20260810 01:45:54.088455 14047 raft_consensus.cc:374] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:54.088515 14047 raft_consensus.cc:729] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1218f7f0532945348f0d0cf7443e05b4, State: Initialized, Role: FOLLOWER
I20260810 01:45:54.088918 13607 heartbeater.cc:503] Master 127.16.58.126:34607 was elected leader, sending a full tablet report...
I20260810 01:45:54.088973 14047 consensus_queue.cc:260] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } }
I20260810 01:45:54.089201 14046 ts_tablet_manager.cc:1428] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 01:45:54.089931 14047 ts_tablet_manager.cc:1428] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 01:45:54.090274 13809 heartbeater.cc:503] Master 127.16.58.126:34607 was elected leader, sending a full tablet report...
I20260810 01:45:54.092365 14048 raft_consensus.cc:348] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } }
I20260810 01:45:54.092561 14048 raft_consensus.cc:374] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:54.092614 14048 raft_consensus.cc:729] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c9f18dd574c45449bc98d7e5ecb32b6, State: Initialized, Role: FOLLOWER
I20260810 01:45:54.092967 14048 consensus_queue.cc:260] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } }
I20260810 01:45:54.094012 14021 heartbeater.cc:503] Master 127.16.58.126:34607 was elected leader, sending a full tablet report...
I20260810 01:45:54.093866 14048 ts_tablet_manager.cc:1428] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260810 01:45:54.267199 14022 tablet.cc:2369] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:45:54.307574 13810 tablet.cc:2369] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:45:54.324154 13608 tablet.cc:2369] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:45:54.405027 14055 raft_consensus.cc:482] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:54.405262 14055 raft_consensus.cc:504] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } }
I20260810 01:45:54.406487 14055 leader_election.cc:288] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c9f18dd574c45449bc98d7e5ecb32b6 (127.16.58.67:40939), 1218f7f0532945348f0d0cf7443e05b4 (127.16.58.66:38271)
I20260810 01:45:54.411712 14038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.406872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:41807 (local address 127.16.58.66:38271)
0810 01:45:54.407012 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:54.407017 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:54.407393 (+ 376us) server_negotiation.cc:407] Connection header received
0810 01:45:54.407506 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:54.407509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:54.407560 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:54.407631 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:54.407940 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.408723 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.410462 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.411063 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.411193 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.411243 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:54.411509 (+ 266us) server_negotiation.cc:299] Negotiation successful
0810 01:45:54.411580 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 01:45:54.411712 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.406883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:51741 (local address 127.16.58.67:40939)
0810 01:45:54.407023 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:54.407028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:54.407285 (+ 257us) server_negotiation.cc:407] Connection header received
0810 01:45:54.407478 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:54.407482 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:54.407532 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:54.407609 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:54.407942 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.408728 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.410462 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.411071 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.411189 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.411243 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:54.411509 (+ 266us) server_negotiation.cc:299] Negotiation successful
0810 01:45:54.411580 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 01:45:54.411751 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.406777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:38271 (local address 127.16.58.65:41807)
0810 01:45:54.407293 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:54.407305 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:54.407403 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:54.407644 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:54.407647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:54.407672 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:54.407827 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.407834 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.408843 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.408847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.410343 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.410352 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.411191 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.411195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.411353 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.411401 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 01:45:54.411471 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 01:45:54.411563 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":180,"spinlock_wait_cycles":896,"thread_start_us":114,"threads_started":1}
I20260810 01:45:54.411754 14061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.406775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:40939 (local address 127.16.58.65:51741)
0810 01:45:54.407181 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:54.407193 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:54.407312 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:54.407644 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:54.407647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:54.407678 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:54.407843 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.407849 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.408843 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.408847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.410339 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:54.410352 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.411191 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.411195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:54.411359 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.411393 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 01:45:54.411471 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 01:45:54.411564 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":168,"spinlock_wait_cycles":7168,"thread_start_us":136,"threads_started":1}
I20260810 01:45:54.412554 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab5b7e818804f8fa6a615f14098e80a" candidate_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1218f7f0532945348f0d0cf7443e05b4" is_pre_election: true
I20260810 01:45:54.412539 13955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab5b7e818804f8fa6a615f14098e80a" candidate_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" is_pre_election: true
I20260810 01:45:54.412869 13741 raft_consensus.cc:2454] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b37ccf1315f043e4afa4d0a3e00a22bc in term 0.
I20260810 01:45:54.412869 13955 raft_consensus.cc:2454] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b37ccf1315f043e4afa4d0a3e00a22bc in term 0.
I20260810 01:45:54.413424 13445 leader_election.cc:302] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1218f7f0532945348f0d0cf7443e05b4, b37ccf1315f043e4afa4d0a3e00a22bc; no voters:
I20260810 01:45:54.413700 14055 raft_consensus.cc:2781] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:45:54.413790 14055 raft_consensus.cc:482] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:45:54.413836 14055 raft_consensus.cc:3037] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:54.414861 14055 raft_consensus.cc:504] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } }
I20260810 01:45:54.415190 14055 leader_election.cc:288] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [CANDIDATE]: Term 1 election: Requested vote from peers 0c9f18dd574c45449bc98d7e5ecb32b6 (127.16.58.67:40939), 1218f7f0532945348f0d0cf7443e05b4 (127.16.58.66:38271)
I20260810 01:45:54.415567 13741 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab5b7e818804f8fa6a615f14098e80a" candidate_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1218f7f0532945348f0d0cf7443e05b4"
I20260810 01:45:54.415696 13955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab5b7e818804f8fa6a615f14098e80a" candidate_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6"
I20260810 01:45:54.415709 13741 raft_consensus.cc:3037] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:54.415845 13955 raft_consensus.cc:3037] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:54.417019 13741 raft_consensus.cc:2454] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b37ccf1315f043e4afa4d0a3e00a22bc in term 1.
I20260810 01:45:54.417019 13955 raft_consensus.cc:2454] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b37ccf1315f043e4afa4d0a3e00a22bc in term 1.
I20260810 01:45:54.417349 13449 leader_election.cc:302] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0c9f18dd574c45449bc98d7e5ecb32b6, 1218f7f0532945348f0d0cf7443e05b4, b37ccf1315f043e4afa4d0a3e00a22bc; no voters:
I20260810 01:45:54.417580 14055 raft_consensus.cc:2781] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:54.417810 14055 raft_consensus.cc:686] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [term 1 LEADER]: Becoming Leader. State: Replica: b37ccf1315f043e4afa4d0a3e00a22bc, State: Running, Role: LEADER
I20260810 01:45:54.418141 14055 consensus_queue.cc:237] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } }
I20260810 01:45:54.421320 13324 catalog_manager.cc:5495] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc reported cstate change: term changed from 0 to 1, leader changed from <none> to b37ccf1315f043e4afa4d0a3e00a22bc (127.16.58.65). New cstate: current_term: 1 leader_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b37ccf1315f043e4afa4d0a3e00a22bc" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 43045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 } health_report { overall_health: UNKNOWN } } }
I20260810 01:45:54.516080 14035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.512571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35712 (local address 127.16.58.65:43045)
0810 01:45:54.512721 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:54.512726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:54.512740 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:45:54.512830 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:54.512832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:54.512889 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:54.512981 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:45:54.513252 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.513760 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.514606 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.514828 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.514915 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.515230 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:45:54.515661 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:45:54.515769 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:54.515879 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 01:45:54.515939 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 01:45:54.522221 13955 raft_consensus.cc:1261] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [term 1 FOLLOWER]: Refusing update from remote peer b37ccf1315f043e4afa4d0a3e00a22bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:54.522222 13741 raft_consensus.cc:1261] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [term 1 FOLLOWER]: Refusing update from remote peer b37ccf1315f043e4afa4d0a3e00a22bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:54.522886 14055 consensus_queue.cc:1035] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1218f7f0532945348f0d0cf7443e05b4" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 38271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:54.523099 14063 consensus_queue.cc:1035] T dab5b7e818804f8fa6a615f14098e80a P b37ccf1315f043e4afa4d0a3e00a22bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c9f18dd574c45449bc98d7e5ecb32b6" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:54.531872 14069 mvcc.cc:205] Tried to move back new op lower bound from 7316792748115419136 to 7316792747699150848. Current Snapshot: MvccSnapshot[applied={T|T < 7316792748115419136}]
I20260810 01:45:54.539943 13322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:54.540122 13322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:54.542567 13322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7bd3034b251946c6954c4913ba69eff5: Sending DeleteTablet for 3 replicas of tablet dab5b7e818804f8fa6a615f14098e80a
I20260810 01:45:54.543365 13706 tablet_service.cc:1514] Processing DeleteTablet for tablet dab5b7e818804f8fa6a615f14098e80a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:54 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:45764
I20260810 01:45:54.543510 13513 tablet_service.cc:1514] Processing DeleteTablet for tablet dab5b7e818804f8fa6a615f14098e80a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:54 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:35698
I20260810 01:45:54.543869 14088 tablet_replica.cc:330] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: stopping tablet replica
I20260810 01:45:54.543958 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 13416
I20260810 01:45:54.544000 13910 tablet_service.cc:1514] Processing DeleteTablet for tablet dab5b7e818804f8fa6a615f14098e80a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:54 UTC) from {username='kudu', principal='kudu/127.16.58.126@KRBTEST.COM'} at 127.0.0.1:60466
I20260810 01:45:54.548309 14088 raft_consensus.cc:2229] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:54.548658 14088 raft_consensus.cc:2258] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:54.550796 14088 ts_tablet_manager.cc:1905] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:54.552533 14090 tablet_replica.cc:330] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: stopping tablet replica
I20260810 01:45:54.552850 14090 raft_consensus.cc:2229] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:54.553198 14090 raft_consensus.cc:2258] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:54.553444 14088 ts_tablet_manager.cc:1918] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:54.553548 14088 log.cc:1196] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/dab5b7e818804f8fa6a615f14098e80a
I20260810 01:45:54.553880 14088 ts_tablet_manager.cc:1939] T dab5b7e818804f8fa6a615f14098e80a P 1218f7f0532945348f0d0cf7443e05b4: Deleting consensus metadata
I20260810 01:45:54.554828 14090 ts_tablet_manager.cc:1905] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:54.555112 13304 catalog_manager.cc:4841] TS 1218f7f0532945348f0d0cf7443e05b4 (127.16.58.66:38271): tablet dab5b7e818804f8fa6a615f14098e80a (table test-table [id=34d97fb16c7a44aeb8eabb64450395f3]) successfully deleted
W20260810 01:45:54.556651 13306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:43045 (error 108)
I20260810 01:45:54.557266 14090 ts_tablet_manager.cc:1918] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:54.557370 14090 log.cc:1196] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/dab5b7e818804f8fa6a615f14098e80a
I20260810 01:45:54.557443 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 13615
I20260810 01:45:54.557650 14037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.557346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:43045 (local address 127.0.0.1:35716)
0810 01:45:54.557487 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:54.557565 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:43045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 01:45:54.568388 13306 catalog_manager.cc:4584] TS b37ccf1315f043e4afa4d0a3e00a22bc (127.16.58.65:43045): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dab5b7e818804f8fa6a615f14098e80a: Network error: Client connection negotiation failed: client connection to 127.16.58.65:43045: connect: Connection refused (error 111)
I20260810 01:45:54.568899 14090 ts_tablet_manager.cc:1939] T dab5b7e818804f8fa6a615f14098e80a P 0c9f18dd574c45449bc98d7e5ecb32b6: Deleting consensus metadata
I20260810 01:45:54.570088 13306 catalog_manager.cc:4841] TS 0c9f18dd574c45449bc98d7e5ecb32b6 (127.16.58.67:40939): tablet dab5b7e818804f8fa6a615f14098e80a (table test-table [id=34d97fb16c7a44aeb8eabb64450395f3]) successfully deleted
I20260810 01:45:54.574043 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 13816
I20260810 01:45:54.581697 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 13279
2026-08-10T01:45:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2734 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T01:45:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:45:54Z Disabled control of system clock
I20260810 01:45:54.617095 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:34507
--webserver_interface=127.16.58.126
--webserver_port=0
--builtin_ntp_servers=127.16.58.84:36251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:34507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:45:54.724749 14097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:54.725008 14097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:54.725042 14097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:54.728896 14097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:54.728943 14097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:54.728957 14097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:54.728971 14097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:54.728988 14097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:54.733659 14097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:36251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:34507
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:34507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:54.734596 14097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:54.735883 14097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:54.743898 14104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:54.743911 14102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:54.743909 14110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:54.744129 14097 server_base.cc:1034] running on GCE node
I20260810 01:45:54.744805 14097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:54.745828 14097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:54.746985 14097 hybrid_clock.cc:648] HybridClock initialized: now 1786326354746962 us; error 41 us; skew 500 ppm
I20260810 01:45:54.748740 14097 webserver.cc:460] Webserver started at http://127.16.58.126:37311/ using document root <none> and password file <none>
I20260810 01:45:54.749279 14097 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:54.749346 14097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:54.749541 14097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:54.751528 14097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "b6efd07744b340c48d27dd9cf3cb51f6"
format_stamp: "Formatted at 2026-08-10 01:45:54 on dist-test-slave-jlzn"
server_key: "0efbcd7e8cef662718c80536aada63cf"
server_key_iv: "e7e15e3d301980d927e33aea5233ffb4"
server_key_version: "encryptionkey@0"
I20260810 01:45:54.752121 14097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "b6efd07744b340c48d27dd9cf3cb51f6"
format_stamp: "Formatted at 2026-08-10 01:45:54 on dist-test-slave-jlzn"
server_key: "0efbcd7e8cef662718c80536aada63cf"
server_key_iv: "e7e15e3d301980d927e33aea5233ffb4"
server_key_version: "encryptionkey@0"
I20260810 01:45:54.755699 14097 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:45:54.758052 14119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:54.759207 14097 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:54.759320 14097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "b6efd07744b340c48d27dd9cf3cb51f6"
format_stamp: "Formatted at 2026-08-10 01:45:54 on dist-test-slave-jlzn"
server_key: "0efbcd7e8cef662718c80536aada63cf"
server_key_iv: "e7e15e3d301980d927e33aea5233ffb4"
server_key_version: "encryptionkey@0"
I20260810 01:45:54.759409 14097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:54.782701 14097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:54.783380 14097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:54.783571 14097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:54.790236 14097 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:34507
I20260810 01:45:54.790254 14199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:34507 every 8 connection(s)
I20260810 01:45:54.791115 14097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:54.792937 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 14097
I20260810 01:45:54.793047 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:45:54.793313 16617 external_mini_cluster.cc:1428] Setting key 24d1e754a6c54c0d32e22f1c80f049e5
I20260810 01:45:54.794461 14201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:54.800514 14201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6: Bootstrap starting.
I20260810 01:45:54.802295 14204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:54.794666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49948 (local address 127.16.58.126:34507)
0810 01:45:54.795263 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:54.795278 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:54.795314 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:45:54.795991 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:54.796010 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:54.796379 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:54.796644 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:54.797016 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.797978 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.799179 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:54.799649 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:54.799759 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:54.800643 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:54.800649 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:54.800665 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:54.801025 (+ 360us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:54.801078 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:54.801098 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:54.801170 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:54.801368 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 01:45:54.801620 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":123,"threads_started":1}
I20260810 01:45:54.802765 14201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:54.803469 14201 log.cc:824] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:54.805320 14201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6: No bootstrap required, opened a new log
I20260810 01:45:54.808656 14201 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6efd07744b340c48d27dd9cf3cb51f6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34507 } }
I20260810 01:45:54.808859 14201 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:54.808907 14201 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6efd07744b340c48d27dd9cf3cb51f6, State: Initialized, Role: FOLLOWER
I20260810 01:45:54.809307 14201 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6efd07744b340c48d27dd9cf3cb51f6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34507 } }
I20260810 01:45:54.809434 14201 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:54.809495 14201 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:54.809583 14201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:54.810381 14201 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6efd07744b340c48d27dd9cf3cb51f6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34507 } }
I20260810 01:45:54.810693 14201 leader_election.cc:302] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6efd07744b340c48d27dd9cf3cb51f6; no voters:
I20260810 01:45:54.810958 14201 leader_election.cc:288] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:45:54.811049 14206 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:54.811297 14206 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [term 1 LEADER]: Becoming Leader. State: Replica: b6efd07744b340c48d27dd9cf3cb51f6, State: Running, Role: LEADER
I20260810 01:45:54.811597 14206 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6efd07744b340c48d27dd9cf3cb51f6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34507 } }
I20260810 01:45:54.812155 14201 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:54.813235 14207 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6efd07744b340c48d27dd9cf3cb51f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6efd07744b340c48d27dd9cf3cb51f6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34507 } } }
I20260810 01:45:54.813237 14208 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6efd07744b340c48d27dd9cf3cb51f6. Latest consensus state: current_term: 1 leader_uuid: "b6efd07744b340c48d27dd9cf3cb51f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6efd07744b340c48d27dd9cf3cb51f6" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 34507 } } }
I20260810 01:45:54.813380 14207 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:54.813380 14208 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:54.813750 14216 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:54.816466 14216 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:54.821671 14216 catalog_manager.cc:1347] Generated new cluster ID: 3b509383879443ea83e5295c22eb9952
I20260810 01:45:54.821722 14216 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:54.828879 14216 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:45:54.830219 14216 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:54.836047 14216 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6: Generated new TSK 0
I20260810 01:45:54.836635 14216 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:45:54.845367 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.65:0
--local_ip_for_outbound_sockets=127.16.58.65
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34507
--builtin_ntp_servers=127.16.58.84:36251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 01:45:54.957438 14233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:54.957682 14233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:54.957719 14233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:54.961577 14233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:54.961625 14233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:54.961681 14233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.65
I20260810 01:45:54.966364 14233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:36251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.58.65
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.65
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:54.967294 14233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:54.968570 14233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:54.977579 14248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:54.977591 14243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:54.977602 14242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:54.977847 14233 server_base.cc:1034] running on GCE node
I20260810 01:45:54.978245 14233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:54.978842 14233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:54.979992 14233 hybrid_clock.cc:648] HybridClock initialized: now 1786326354979977 us; error 26 us; skew 500 ppm
I20260810 01:45:54.981663 14233 webserver.cc:460] Webserver started at http://127.16.58.65:38967/ using document root <none> and password file <none>
I20260810 01:45:54.982178 14233 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:54.982241 14233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:54.982437 14233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:54.984388 14233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/data/instance:
uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9"
format_stamp: "Formatted at 2026-08-10 01:45:54 on dist-test-slave-jlzn"
server_key: "95c54058e15ef5a30158030c717810fb"
server_key_iv: "375c11c2975ed4d09135a678930bc53e"
server_key_version: "encryptionkey@0"
I20260810 01:45:54.984916 14233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance:
uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9"
format_stamp: "Formatted at 2026-08-10 01:45:54 on dist-test-slave-jlzn"
server_key: "95c54058e15ef5a30158030c717810fb"
server_key_iv: "375c11c2975ed4d09135a678930bc53e"
server_key_version: "encryptionkey@0"
I20260810 01:45:54.988240 14233 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:45:54.990391 14256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:54.991469 14233 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:54.991590 14233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/wal
uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9"
format_stamp: "Formatted at 2026-08-10 01:45:54 on dist-test-slave-jlzn"
server_key: "95c54058e15ef5a30158030c717810fb"
server_key_iv: "375c11c2975ed4d09135a678930bc53e"
server_key_version: "encryptionkey@0"
I20260810 01:45:54.991685 14233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:55.001587 14233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:55.002133 14233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:55.002290 14233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:55.002795 14233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:55.003630 14233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:55.003679 14233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:55.003727 14233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:55.003756 14233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:55.011917 14233 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.65:38183
I20260810 01:45:55.011951 14429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.65:38183 every 8 connection(s)
I20260810 01:45:55.012786 14233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/data/info.pb
I20260810 01:45:55.021693 14204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.014564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.65:42031 (local address 127.16.58.126:34507)
0810 01:45:55.014691 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.014695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.015707 (+ 1012us) server_negotiation.cc:407] Connection header received
0810 01:45:55.017074 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.017077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.017137 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.017211 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:55.018073 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.018606 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.019869 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.020092 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.020185 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.021201 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:55.021205 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:55.021208 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:55.021220 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:55.021240 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:55.021247 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:55.021307 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.021451 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.021537 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:45:55.022066 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 14233
I20260810 01:45:55.022192 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-0/wal/instance
I20260810 01:45:55.022491 16617 external_mini_cluster.cc:1428] Setting key bfef6a72cb74df892b7229265b523ad1
I20260810 01:45:55.022614 14436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.014914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34507 (local address 127.16.58.65:42031)
0810 01:45:55.015559 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:55.015598 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:55.016859 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:55.017392 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:55.017398 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:55.017477 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:55.017928 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.017940 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.018740 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.018743 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.019735 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.019745 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.020247 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.020251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.020400 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.020953 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:45:55.020955 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:55.020993 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:45:55.021053 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:55.021322 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:55.021332 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:55.021338 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:45:55.021440 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 01:45:55.021696 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":130,"threads_started":1}
I20260810 01:45:55.023787 14431 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34507
I20260810 01:45:55.024027 14431 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:55.024592 14431 heartbeater.cc:511] Master 127.16.58.126:34507 requested a full tablet report, sending...
I20260810 01:45:55.024709 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.66:0
--local_ip_for_outbound_sockets=127.16.58.66
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34507
--builtin_ntp_servers=127.16.58.84:36251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:45:55.026023 14144 ts_manager.cc:194] Registered new tserver with Master: 4adc6ab4b6724c7ab01b29c94eb5f0e9 (127.16.58.65:38183)
I20260810 01:45:55.027508 14144 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.65:42031
W20260810 01:45:55.134045 14437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:55.134305 14437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:55.134339 14437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:55.138556 14437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:55.138615 14437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:55.138679 14437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.66
I20260810 01:45:55.143450 14437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:36251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.58.66
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.66
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:55.144512 14437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:55.145865 14437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:55.155069 14446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:55.155077 14450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:55.155088 14447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:55.155247 14437 server_base.cc:1034] running on GCE node
I20260810 01:45:55.155733 14437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:55.156348 14437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:55.157503 14437 hybrid_clock.cc:648] HybridClock initialized: now 1786326355157487 us; error 27 us; skew 500 ppm
I20260810 01:45:55.159188 14437 webserver.cc:460] Webserver started at http://127.16.58.66:45319/ using document root <none> and password file <none>
I20260810 01:45:55.159737 14437 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:55.159821 14437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:55.160040 14437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:55.162038 14437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/data/instance:
uuid: "b62c94f1a9824d049d51823a18a68804"
format_stamp: "Formatted at 2026-08-10 01:45:55 on dist-test-slave-jlzn"
server_key: "b34625eb64558c941c09f79fdee76401"
server_key_iv: "cdd1f8c1324ca6eec0185e71dc13fdc2"
server_key_version: "encryptionkey@0"
I20260810 01:45:55.162613 14437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance:
uuid: "b62c94f1a9824d049d51823a18a68804"
format_stamp: "Formatted at 2026-08-10 01:45:55 on dist-test-slave-jlzn"
server_key: "b34625eb64558c941c09f79fdee76401"
server_key_iv: "cdd1f8c1324ca6eec0185e71dc13fdc2"
server_key_version: "encryptionkey@0"
I20260810 01:45:55.166194 14437 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260810 01:45:55.168509 14458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:55.169646 14437 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:45:55.169747 14437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/wal
uuid: "b62c94f1a9824d049d51823a18a68804"
format_stamp: "Formatted at 2026-08-10 01:45:55 on dist-test-slave-jlzn"
server_key: "b34625eb64558c941c09f79fdee76401"
server_key_iv: "cdd1f8c1324ca6eec0185e71dc13fdc2"
server_key_version: "encryptionkey@0"
I20260810 01:45:55.169852 14437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:55.183874 14437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:55.184469 14437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:55.184628 14437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:55.185171 14437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:55.186059 14437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:55.186107 14437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:55.186147 14437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:55.186177 14437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:55.194689 14437 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.66:39117
I20260810 01:45:55.194732 14651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.66:39117 every 8 connection(s)
I20260810 01:45:55.195688 14437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/data/info.pb
I20260810 01:45:55.201689 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 14437
I20260810 01:45:55.201794 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/wal/instance
I20260810 01:45:55.202056 16617 external_mini_cluster.cc:1428] Setting key 996c0fc14e7fa6be3623ddb5f4cd4e2b
I20260810 01:45:55.204023 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.58.67:0
--local_ip_for_outbound_sockets=127.16.58.67
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34507
--builtin_ntp_servers=127.16.58.84:36251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 01:45:55.204880 14204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.197577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:45253 (local address 127.16.58.126:34507)
0810 01:45:55.197714 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.197718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.198691 (+ 973us) server_negotiation.cc:407] Connection header received
0810 01:45:55.200102 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.200106 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.200167 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.200242 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:55.201084 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.201631 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.202957 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.203177 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.203284 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.204413 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:55.204417 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:55.204420 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:55.204432 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:55.204453 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:55.204461 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:55.204519 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.204674 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.204737 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:45:55.205698 14655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.197935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34507 (local address 127.16.58.66:45253)
0810 01:45:55.198550 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:55.198587 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:55.199905 (+ 1318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:55.200408 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:55.200414 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:55.200492 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:55.200938 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.200950 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.201766 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.201769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.202853 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.202864 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.203346 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.203350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.203545 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.204153 (+ 608us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:45:55.204155 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:55.204208 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:45:55.204270 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:55.204537 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:55.204545 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:55.204552 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 01:45:55.204660 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 01:45:55.204914 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":119,"threads_started":1}
I20260810 01:45:55.206768 14652 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34507
I20260810 01:45:55.206971 14652 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:55.207501 14652 heartbeater.cc:511] Master 127.16.58.126:34507 requested a full tablet report, sending...
I20260810 01:45:55.208557 14144 ts_manager.cc:194] Registered new tserver with Master: b62c94f1a9824d049d51823a18a68804 (127.16.58.66:39117)
I20260810 01:45:55.209127 14144 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.66:45253
W20260810 01:45:55.314035 14656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:55.314265 14656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:55.314304 14656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:55.318192 14656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:55.318239 14656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:55.318296 14656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.58.67
I20260810 01:45:55.322907 14656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:36251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.58.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.58.67
--webserver_port=0
--tserver_master_addrs=127.16.58.126:34507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.58.67
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:55.323881 14656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:55.325169 14656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:55.334568 14668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:55.334568 14666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:55.334633 14656 server_base.cc:1034] running on GCE node
W20260810 01:45:55.334599 14664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:55.335155 14656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:55.335777 14656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:55.336982 14656 hybrid_clock.cc:648] HybridClock initialized: now 1786326355336954 us; error 35 us; skew 500 ppm
I20260810 01:45:55.338598 14656 webserver.cc:460] Webserver started at http://127.16.58.67:46733/ using document root <none> and password file <none>
I20260810 01:45:55.339114 14656 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:55.339171 14656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:55.339339 14656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:55.341334 14656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/data/instance:
uuid: "e0d5a208e00b45c48a0009d46bdac5f7"
format_stamp: "Formatted at 2026-08-10 01:45:55 on dist-test-slave-jlzn"
server_key: "f101eba385747aa5c7c7ca09ef6858fa"
server_key_iv: "bafa6c47d5eaeae7f61b620ac28f9c2d"
server_key_version: "encryptionkey@0"
I20260810 01:45:55.341847 14656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance:
uuid: "e0d5a208e00b45c48a0009d46bdac5f7"
format_stamp: "Formatted at 2026-08-10 01:45:55 on dist-test-slave-jlzn"
server_key: "f101eba385747aa5c7c7ca09ef6858fa"
server_key_iv: "bafa6c47d5eaeae7f61b620ac28f9c2d"
server_key_version: "encryptionkey@0"
I20260810 01:45:55.345356 14656 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260810 01:45:55.347530 14682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:55.348662 14656 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:45:55.348767 14656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/wal
uuid: "e0d5a208e00b45c48a0009d46bdac5f7"
format_stamp: "Formatted at 2026-08-10 01:45:55 on dist-test-slave-jlzn"
server_key: "f101eba385747aa5c7c7ca09ef6858fa"
server_key_iv: "bafa6c47d5eaeae7f61b620ac28f9c2d"
server_key_version: "encryptionkey@0"
I20260810 01:45:55.348847 14656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:55.369791 14656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:55.370384 14656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:55.370528 14656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:55.371038 14656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 01:45:55.372014 14656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 01:45:55.372064 14656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:55.372108 14656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 01:45:55.372138 14656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:55.380221 14656 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.67:36775
I20260810 01:45:55.380280 14878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.67:36775 every 8 connection(s)
I20260810 01:45:55.381058 14656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/data/info.pb
I20260810 01:45:55.381430 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 14656
I20260810 01:45:55.381544 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/wal/instance
I20260810 01:45:55.381857 16617 external_mini_cluster.cc:1428] Setting key db2bc189af5e508fedede023c54272d0
I20260810 01:45:55.389673 14204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.382758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.67:37789 (local address 127.16.58.126:34507)
0810 01:45:55.382890 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.382894 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.384029 (+ 1135us) server_negotiation.cc:407] Connection header received
0810 01:45:55.385358 (+ 1329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.385362 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.385418 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.385489 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:55.386329 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.386845 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.387977 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.388204 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.388293 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.389230 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:55.389234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:55.389236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:55.389247 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:55.389265 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:55.389273 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:55.389330 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.389473 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.389532 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:45:55.390431 14881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.383183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:34507 (local address 127.16.58.67:37789)
0810 01:45:55.383891 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:55.383946 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:55.385163 (+ 1217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:55.385671 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:55.385677 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:55.385755 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:45:55.386194 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.386206 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.386964 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.386967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.387865 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.387876 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.388341 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.388346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.388496 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.388994 (+ 498us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 01:45:55.388996 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:45:55.389032 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 01:45:55.389091 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:45:55.389346 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:45:55.389355 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:45:55.389361 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 01:45:55.389460 (+ 99us) client_negotiation.cc:240] Negotiation successful
0810 01:45:55.389720 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":108,"threads_started":1}
I20260810 01:45:55.391363 14879 heartbeater.cc:347] Connected to a master server at 127.16.58.126:34507
I20260810 01:45:55.391567 14879 heartbeater.cc:464] Registering TS with master...
I20260810 01:45:55.392058 14879 heartbeater.cc:511] Master 127.16.58.126:34507 requested a full tablet report, sending...
I20260810 01:45:55.392967 14144 ts_manager.cc:194] Registered new tserver with Master: e0d5a208e00b45c48a0009d46bdac5f7 (127.16.58.67:36775)
I20260810 01:45:55.393473 14144 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.16.58.67:37789
I20260810 01:45:55.395561 16617 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 01:45:55.400838 14204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.397481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49956 (local address 127.16.58.126:34507)
0810 01:45:55.397607 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.397611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.397764 (+ 153us) server_negotiation.cc:407] Connection header received
0810 01:45:55.397862 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.397865 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.397904 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.397966 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:55.398239 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.398713 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.399519 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.399728 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.399828 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.400469 (+ 641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:55.400472 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:55.400475 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:55.400487 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:55.400503 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:55.400510 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:55.400566 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.400677 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.400724 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 01:45:55.403229 14144 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49956:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 01:45:55.406068 14144 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 01:45:55.419456 14896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.413590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.66:39117 (local address 127.0.0.1:44474)
0810 01:45:55.414438 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:55.414486 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:55.414600 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:55.415306 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:55.415312 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:55.415335 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:55.415437 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.415443 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.416918 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.416921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.418076 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.418086 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.418943 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.418946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.419061 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.419098 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 01:45:55.419202 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 01:45:55.419316 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":85,"threads_started":1}
I20260810 01:45:55.419476 14897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.413725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44474 (local address 127.16.58.66:39117)
0810 01:45:55.414589 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.414601 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.414627 (+ 26us) server_negotiation.cc:407] Connection header received
0810 01:45:55.414792 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.414798 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.414995 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.415123 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:55.415569 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.416795 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.418193 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.418818 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.418919 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.419116 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.419232 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.419330 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":758,"thread_start_us":109,"threads_started":1}
I20260810 01:45:55.419870 14898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.413757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:36775 (local address 127.0.0.1:57100)
0810 01:45:55.414707 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:55.414720 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:55.414802 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:55.416080 (+ 1278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:55.416083 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:55.416100 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:55.416197 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.416203 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.417210 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.417212 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.418154 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.418165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.419344 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.419348 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.419430 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.419452 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 01:45:55.419644 (+ 192us) client_negotiation.cc:240] Negotiation successful
0810 01:45:55.419719 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":871,"thread_start_us":83,"threads_started":1}
I20260810 01:45:55.420531 14899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.414280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57100 (local address 127.16.58.67:36775)
0810 01:45:55.415712 (+ 1432us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.415722 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.415742 (+ 20us) server_negotiation.cc:407] Connection header received
0810 01:45:55.415794 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.415797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.415963 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.416080 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:55.416301 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.417099 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.418273 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.419031 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.419128 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.419287 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.420291 (+ 1004us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.420381 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1328,"thread_start_us":140,"threads_started":1}
I20260810 01:45:55.421054 14893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.414212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:38183 (local address 127.0.0.1:47598)
0810 01:45:55.414754 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:55.414766 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:55.414834 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:55.415467 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:55.415470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:55.415486 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:55.415576 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.415582 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.418200 (+ 2618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.418201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.419324 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.419333 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.420533 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.420536 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.420771 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.420797 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 01:45:55.420869 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 01:45:55.420938 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":97,"threads_started":1}
I20260810 01:45:55.421171 14900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.414358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47598 (local address 127.16.58.65:38183)
0810 01:45:55.415049 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.415059 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.415082 (+ 23us) server_negotiation.cc:407] Connection header received
0810 01:45:55.415169 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.415174 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.415342 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.415458 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:55.415683 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.416813 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.419451 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.420406 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.420509 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.420679 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.420920 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.421016 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":105,"threads_started":1}
I20260810 01:45:55.422468 14537 tablet_service.cc:1467] Processing CreateTablet for tablet f23a1f2986f745bba1fdd8bb47305a86 (DEFAULT_TABLE table=test-table [id=6bda1a2b8c534f4d9e08b78d94fc98e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:55.423352 14537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23a1f2986f745bba1fdd8bb47305a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:55.423333 14329 tablet_service.cc:1467] Processing CreateTablet for tablet f23a1f2986f745bba1fdd8bb47305a86 (DEFAULT_TABLE table=test-table [id=6bda1a2b8c534f4d9e08b78d94fc98e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:55.424154 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23a1f2986f745bba1fdd8bb47305a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:55.427193 14757 tablet_service.cc:1467] Processing CreateTablet for tablet f23a1f2986f745bba1fdd8bb47305a86 (DEFAULT_TABLE table=test-table [id=6bda1a2b8c534f4d9e08b78d94fc98e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 01:45:55.428157 14757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f23a1f2986f745bba1fdd8bb47305a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:55.429904 14901 tablet_bootstrap.cc:492] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9: Bootstrap starting.
I20260810 01:45:55.431273 14903 tablet_bootstrap.cc:492] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: Bootstrap starting.
I20260810 01:45:55.432392 14901 tablet_bootstrap.cc:654] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:55.433075 14901 log.cc:824] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:55.433408 14903 tablet_bootstrap.cc:654] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:55.434218 14903 log.cc:824] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:55.435441 14901 tablet_bootstrap.cc:492] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9: No bootstrap required, opened a new log
I20260810 01:45:55.435489 14908 tablet_bootstrap.cc:492] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: Bootstrap starting.
I20260810 01:45:55.435626 14901 ts_tablet_manager.cc:1397] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 01:45:55.436393 14903 tablet_bootstrap.cc:492] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: No bootstrap required, opened a new log
I20260810 01:45:55.436565 14903 ts_tablet_manager.cc:1397] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260810 01:45:55.437500 14908 tablet_bootstrap.cc:654] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:55.438272 14908 log.cc:824] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:55.439059 14901 raft_consensus.cc:348] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } }
I20260810 01:45:55.439265 14901 raft_consensus.cc:374] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:55.439318 14901 raft_consensus.cc:729] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4adc6ab4b6724c7ab01b29c94eb5f0e9, State: Initialized, Role: FOLLOWER
I20260810 01:45:55.439713 14901 consensus_queue.cc:260] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } }
I20260810 01:45:55.440143 14908 tablet_bootstrap.cc:492] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: No bootstrap required, opened a new log
I20260810 01:45:55.440317 14908 ts_tablet_manager.cc:1397] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260810 01:45:55.440384 14431 heartbeater.cc:503] Master 127.16.58.126:34507 was elected leader, sending a full tablet report...
I20260810 01:45:55.440409 14903 raft_consensus.cc:348] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } }
I20260810 01:45:55.440655 14901 ts_tablet_manager.cc:1428] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260810 01:45:55.440656 14903 raft_consensus.cc:374] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:55.440711 14903 raft_consensus.cc:729] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b62c94f1a9824d049d51823a18a68804, State: Initialized, Role: FOLLOWER
I20260810 01:45:55.441107 14903 consensus_queue.cc:260] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } }
I20260810 01:45:55.441736 14652 heartbeater.cc:503] Master 127.16.58.126:34507 was elected leader, sending a full tablet report...
I20260810 01:45:55.442009 14903 ts_tablet_manager.cc:1428] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
I20260810 01:45:55.444175 14908 raft_consensus.cc:348] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } }
I20260810 01:45:55.444424 14908 raft_consensus.cc:374] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:55.444495 14908 raft_consensus.cc:729] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0d5a208e00b45c48a0009d46bdac5f7, State: Initialized, Role: FOLLOWER
I20260810 01:45:55.444895 14908 consensus_queue.cc:260] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } }
I20260810 01:45:55.445490 14879 heartbeater.cc:503] Master 127.16.58.126:34507 was elected leader, sending a full tablet report...
I20260810 01:45:55.445744 14908 ts_tablet_manager.cc:1428] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260810 01:45:55.447332 14653 tablet.cc:2369] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:45:55.513991 14434 tablet.cc:2369] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:45:55.606799 14915 raft_consensus.cc:482] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:45:55.607007 14915 raft_consensus.cc:504] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } }
I20260810 01:45:55.608217 14915 leader_election.cc:288] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0d5a208e00b45c48a0009d46bdac5f7 (127.16.58.67:36775), 4adc6ab4b6724c7ab01b29c94eb5f0e9 (127.16.58.65:38183)
I20260810 01:45:55.612831 14900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.608566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:58213 (local address 127.16.58.65:38183)
0810 01:45:55.608700 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.608705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.608986 (+ 281us) server_negotiation.cc:407] Connection header received
0810 01:45:55.609117 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.609120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.609172 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.609229 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:55.609490 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.610189 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.611585 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.612224 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.612341 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.612394 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.612626 (+ 232us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.612696 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:45:55.612831 14899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.608545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.16.58.66:55855 (local address 127.16.58.67:36775)
0810 01:45:55.608654 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.608659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.608688 (+ 29us) server_negotiation.cc:407] Connection header received
0810 01:45:55.608853 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.608856 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.608901 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.608962 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 01:45:55.609313 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.610067 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.611596 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.612224 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.612341 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.612394 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.612618 (+ 224us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.612699 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:45:55.612881 14655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.608422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.67:36775 (local address 127.16.58.66:55855)
0810 01:45:55.608609 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:55.608637 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:55.608724 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:55.609043 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:55.609046 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:55.609062 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:55.609189 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.609195 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.610174 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.610176 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.611464 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.611473 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.612336 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.612340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.612487 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.612515 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 01:45:55.612596 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 01:45:55.612686 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":29}
I20260810 01:45:55.613058 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.608471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:38183 (local address 127.16.58.66:58213)
0810 01:45:55.608891 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:55.608902 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 01:45:55.608996 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:45:55.609263 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:45:55.609266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:45:55.609286 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 01:45:55.609387 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.609392 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.610275 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.610278 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.611461 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:45:55.611473 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.612336 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.612340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:45:55.612520 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.612539 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 01:45:55.612602 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 01:45:55.612699 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":45,"thread_start_us":125,"threads_started":1}
I20260810 01:45:55.613550 14795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23a1f2986f745bba1fdd8bb47305a86" candidate_uuid: "b62c94f1a9824d049d51823a18a68804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" is_pre_election: true
I20260810 01:45:55.613727 14363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23a1f2986f745bba1fdd8bb47305a86" candidate_uuid: "b62c94f1a9824d049d51823a18a68804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" is_pre_election: true
I20260810 01:45:55.613898 14795 raft_consensus.cc:2454] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b62c94f1a9824d049d51823a18a68804 in term 0.
I20260810 01:45:55.613971 14363 raft_consensus.cc:2454] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b62c94f1a9824d049d51823a18a68804 in term 0.
I20260810 01:45:55.614368 14459 leader_election.cc:302] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4adc6ab4b6724c7ab01b29c94eb5f0e9, b62c94f1a9824d049d51823a18a68804; no voters:
I20260810 01:45:55.614600 14915 raft_consensus.cc:2781] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 01:45:55.614693 14915 raft_consensus.cc:482] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 01:45:55.614740 14915 raft_consensus.cc:3037] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:55.615741 14915 raft_consensus.cc:504] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } }
I20260810 01:45:55.616089 14915 leader_election.cc:288] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [CANDIDATE]: Term 1 election: Requested vote from peers e0d5a208e00b45c48a0009d46bdac5f7 (127.16.58.67:36775), 4adc6ab4b6724c7ab01b29c94eb5f0e9 (127.16.58.65:38183)
I20260810 01:45:55.616420 14795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23a1f2986f745bba1fdd8bb47305a86" candidate_uuid: "b62c94f1a9824d049d51823a18a68804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0d5a208e00b45c48a0009d46bdac5f7"
I20260810 01:45:55.616420 14363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f23a1f2986f745bba1fdd8bb47305a86" candidate_uuid: "b62c94f1a9824d049d51823a18a68804" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9"
I20260810 01:45:55.616539 14795 raft_consensus.cc:3037] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:55.616539 14363 raft_consensus.cc:3037] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:55.617753 14795 raft_consensus.cc:2454] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b62c94f1a9824d049d51823a18a68804 in term 1.
I20260810 01:45:55.617753 14363 raft_consensus.cc:2454] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b62c94f1a9824d049d51823a18a68804 in term 1.
I20260810 01:45:55.618054 14462 leader_election.cc:302] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b62c94f1a9824d049d51823a18a68804, e0d5a208e00b45c48a0009d46bdac5f7; no voters:
I20260810 01:45:55.618201 14915 raft_consensus.cc:2781] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:55.618427 14915 raft_consensus.cc:686] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 1 LEADER]: Becoming Leader. State: Replica: b62c94f1a9824d049d51823a18a68804, State: Running, Role: LEADER
I20260810 01:45:55.618753 14915 consensus_queue.cc:237] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } }
I20260810 01:45:55.621797 14143 catalog_manager.cc:5495] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 reported cstate change: term changed from 0 to 1, leader changed from <none> to b62c94f1a9824d049d51823a18a68804 (127.16.58.66). New cstate: current_term: 1 leader_uuid: "b62c94f1a9824d049d51823a18a68804" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b62c94f1a9824d049d51823a18a68804" member_type: VOTER last_known_addr { host: "127.16.58.66" port: 39117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 } health_report { overall_health: UNKNOWN } } }
W20260810 01:45:55.632149 14880 tablet.cc:2369] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:45:55.651366 14897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.648446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44480 (local address 127.16.58.66:39117)
0810 01:45:55.648559 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:55.648563 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:55.648575 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:45:55.648643 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:55.648646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:55.648698 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:55.648779 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:45:55.648954 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.649440 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.650199 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:55.650398 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:55.650462 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:55.650673 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:45:55.651053 (+ 380us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:45:55.651144 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:55.651169 (+ 25us) server_negotiation.cc:299] Negotiation successful
0810 01:45:55.651214 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:45:55.657089 14795 raft_consensus.cc:1261] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [term 1 FOLLOWER]: Refusing update from remote peer b62c94f1a9824d049d51823a18a68804: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:55.657119 14363 raft_consensus.cc:1261] T f23a1f2986f745bba1fdd8bb47305a86 P 4adc6ab4b6724c7ab01b29c94eb5f0e9 [term 1 FOLLOWER]: Refusing update from remote peer b62c94f1a9824d049d51823a18a68804: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:45:55.657725 14920 consensus_queue.cc:1035] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4adc6ab4b6724c7ab01b29c94eb5f0e9" member_type: VOTER last_known_addr { host: "127.16.58.65" port: 38183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:55.657904 14915 consensus_queue.cc:1035] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0d5a208e00b45c48a0009d46bdac5f7" member_type: VOTER last_known_addr { host: "127.16.58.67" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:45:55.666762 14929 mvcc.cc:205] Tried to move back new op lower bound from 7316792752764850176 to 7316792752616673280. Current Snapshot: MvccSnapshot[applied={T|T < 7316792752764850176}]
I20260810 01:45:55.672545 14145 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:55.672716 14145 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 01:45:55.675113 14145 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b6efd07744b340c48d27dd9cf3cb51f6: Sending DeleteTablet for 3 replicas of tablet f23a1f2986f745bba1fdd8bb47305a86
I20260810 01:45:55.675792 14757 tablet_service.cc:1514] Processing DeleteTablet for tablet f23a1f2986f745bba1fdd8bb47305a86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:55 UTC) from {username='slave'} at 127.0.0.1:57100
I20260810 01:45:55.675850 14537 tablet_service.cc:1514] Processing DeleteTablet for tablet f23a1f2986f745bba1fdd8bb47305a86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:55 UTC) from {username='slave'} at 127.0.0.1:44474
I20260810 01:45:55.676280 14942 tablet_replica.cc:330] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: stopping tablet replica
I20260810 01:45:55.676507 14943 tablet_replica.cc:330] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: stopping tablet replica
I20260810 01:45:55.676506 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 14233
I20260810 01:45:55.676519 14329 tablet_service.cc:1514] Processing DeleteTablet for tablet f23a1f2986f745bba1fdd8bb47305a86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 01:45:55 UTC) from {username='slave'} at 127.0.0.1:47598
I20260810 01:45:55.676868 14943 raft_consensus.cc:2229] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 01:45:55.677229 14942 raft_consensus.cc:2229] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 1 LEADER]: Raft consensus shutting down.
I20260810 01:45:55.677627 14943 raft_consensus.cc:2258] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:55.678311 14942 raft_consensus.cc:2258] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 01:45:55.687067 14943 ts_tablet_manager.cc:1905] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:55.688078 14942 ts_tablet_manager.cc:1905] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 01:45:55.689730 14943 ts_tablet_manager.cc:1918] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:55.689829 14943 log.cc:1196] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-2/wal/wals/f23a1f2986f745bba1fdd8bb47305a86
I20260810 01:45:55.690119 14943 ts_tablet_manager.cc:1939] T f23a1f2986f745bba1fdd8bb47305a86 P e0d5a208e00b45c48a0009d46bdac5f7: Deleting consensus metadata
I20260810 01:45:55.690934 14942 ts_tablet_manager.cc:1918] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 01:45:55.691083 14942 log.cc:1196] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: Deleting WAL directory at /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786326110151381-16617-0/minicluster-data/ts-1/wal/wals/f23a1f2986f745bba1fdd8bb47305a86
I20260810 01:45:55.691334 14122 catalog_manager.cc:4841] TS e0d5a208e00b45c48a0009d46bdac5f7 (127.16.58.67:36775): tablet f23a1f2986f745bba1fdd8bb47305a86 (table test-table [id=6bda1a2b8c534f4d9e08b78d94fc98e3]) successfully deleted
I20260810 01:45:55.691512 14942 ts_tablet_manager.cc:1939] T f23a1f2986f745bba1fdd8bb47305a86 P b62c94f1a9824d049d51823a18a68804: Deleting consensus metadata
I20260810 01:45:55.692446 14121 catalog_manager.cc:4841] TS b62c94f1a9824d049d51823a18a68804 (127.16.58.66:39117): tablet f23a1f2986f745bba1fdd8bb47305a86 (table test-table [id=6bda1a2b8c534f4d9e08b78d94fc98e3]) successfully deleted
W20260810 01:45:55.693198 14120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.16.58.65:38183 (error 108)
I20260810 01:45:55.694001 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 14437
I20260810 01:45:55.697260 14893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:55.693858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.65:38183 (local address 127.0.0.1:47604)
0810 01:45:55.697106 (+ 3248us) negotiation.cc:107] Waiting for socket to connect
0810 01:45:55.697189 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.65:38183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260810 01:45:55.697504 14120 catalog_manager.cc:4584] TS 4adc6ab4b6724c7ab01b29c94eb5f0e9 (127.16.58.65:38183): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f23a1f2986f745bba1fdd8bb47305a86: Network error: Client connection negotiation failed: client connection to 127.16.58.65:38183: connect: Connection refused (error 111)
I20260810 01:45:55.702294 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 14656
I20260810 01:45:55.716876 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 14097
2026-08-10T01:45:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1136 ms)
[----------] 6 tests from EncryptionPolicyTest (10837 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:45:55 dist-test-slave-jlzn krb5kdc[14947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:45:55 dist-test-slave-jlzn krb5kdc[14947](info): set up 2 sockets
Aug 10 01:45:55 dist-test-slave-jlzn krb5kdc[14947](info): commencing operation
krb5kdc: starting...
W20260810 01:45:56.845427 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:45:56 dist-test-slave-jlzn krb5kdc[14947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:45:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:45:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:45:56.962841 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:57.071106 14964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:57.071364 14964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:57.071403 14964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:57.075294 14964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:57.075351 14964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:57.075368 14964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:57.075387 14964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:57.075402 14964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:57.080451 14964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35431
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:57.081349 14964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:57.082263 14964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:57.090447 14969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:57.090449 14970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:57.090483 14964 server_base.cc:1034] running on GCE node
W20260810 01:45:57.090459 14973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:57.091192 14964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:57.092290 14964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:57.093444 14964 hybrid_clock.cc:648] HybridClock initialized: now 1786326357093424 us; error 33 us; skew 500 ppm
Aug 10 01:45:57 dist-test-slave-jlzn krb5kdc[14947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326357, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:57.099334 14964 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:45:57.100227 14964 webserver.cc:460] Webserver started at http://127.0.0.1:41423/ using document root <none> and password file <none>
I20260810 01:45:57.100735 14964 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:57.100795 14964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:57.100997 14964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:57.102967 14964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "2166587582134880a35d9891a31bab04"
format_stamp: "Formatted at 2026-08-10 01:45:57 on dist-test-slave-jlzn"
server_key: "c96df73e41d784ae76ab4093e7612d64"
server_key_iv: "5888cbee30ff0c1063950d477dfd4cbd"
server_key_version: "encryptionkey@0"
I20260810 01:45:57.103513 14964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "2166587582134880a35d9891a31bab04"
format_stamp: "Formatted at 2026-08-10 01:45:57 on dist-test-slave-jlzn"
server_key: "c96df73e41d784ae76ab4093e7612d64"
server_key_iv: "5888cbee30ff0c1063950d477dfd4cbd"
server_key_version: "encryptionkey@0"
I20260810 01:45:57.106994 14964 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:45:57.109300 14985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:57.110432 14964 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:45:57.110535 14964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "2166587582134880a35d9891a31bab04"
format_stamp: "Formatted at 2026-08-10 01:45:57 on dist-test-slave-jlzn"
server_key: "c96df73e41d784ae76ab4093e7612d64"
server_key_iv: "5888cbee30ff0c1063950d477dfd4cbd"
server_key_version: "encryptionkey@0"
I20260810 01:45:57.110639 14964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:57.124148 14964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:57.126752 14964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:57.126914 14964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:57.133791 14964 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35431
I20260810 01:45:57.133806 15074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35431 every 8 connection(s)
I20260810 01:45:57.134687 14964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:57.137353 15076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:57.138159 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 14964
I20260810 01:45:57.138281 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:45:57.138543 16617 external_mini_cluster.cc:1428] Setting key e347dd146bfdae845c816ab9cd4b074e
I20260810 01:45:57.143385 15076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04: Bootstrap starting.
I20260810 01:45:57.146018 15076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:57.146898 15076 log.cc:824] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04: Log is configured to *not* fsync() on all Append() calls
Aug 10 01:45:57 dist-test-slave-jlzn krb5kdc[14947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 01:45:57.148764 15076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04: No bootstrap required, opened a new log
I20260810 01:45:57.152287 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:57.139836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51703 (local address 127.0.0.1:35431)
0810 01:45:57.140244 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:57.140259 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:57.140294 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:45:57.140913 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:57.140928 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:57.141242 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:57.141500 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:57.142418 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:57.143366 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:57.144530 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:57.144992 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:57.145106 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:57.147932 (+ 2826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:57.147937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:57.147949 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:57.147974 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:57.149506 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:57.149993 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:57.149998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:57.150002 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:57.150111 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:57.150437 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:57.150439 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:57.150440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:57.150810 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:57.150999 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:57.151319 (+ 320us) server_negotiation.cc:299] Negotiation successful
0810 01:45:57.151537 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":108,"threads_started":1}
I20260810 01:45:57.152146 15076 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166587582134880a35d9891a31bab04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } }
I20260810 01:45:57.152407 15076 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:57.152465 15076 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2166587582134880a35d9891a31bab04, State: Initialized, Role: FOLLOWER
I20260810 01:45:57.152869 15076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166587582134880a35d9891a31bab04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } }
I20260810 01:45:57.152998 15076 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:57.153069 15076 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:57.153170 15076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:57.154233 15076 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166587582134880a35d9891a31bab04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } }
I20260810 01:45:57.154564 15076 leader_election.cc:302] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2166587582134880a35d9891a31bab04; no voters:
I20260810 01:45:57.154872 15076 leader_election.cc:288] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:45:57.154961 15087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:57.155170 15087 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [term 1 LEADER]: Becoming Leader. State: Replica: 2166587582134880a35d9891a31bab04, State: Running, Role: LEADER
I20260810 01:45:57.155217 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:45:57.155459 15087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166587582134880a35d9891a31bab04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } }
I20260810 01:45:57.156150 15076 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:57.156517 15087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2166587582134880a35d9891a31bab04. Latest consensus state: current_term: 1 leader_uuid: "2166587582134880a35d9891a31bab04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166587582134880a35d9891a31bab04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } } }
I20260810 01:45:57.156646 15087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:57.157085 15089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2166587582134880a35d9891a31bab04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2166587582134880a35d9891a31bab04" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35431 } } }
I20260810 01:45:57.157251 15089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04 [sys.catalog]: This master's current role is: LEADER
W20260810 01:45:57.160984 15115 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:45:57.161098 15115 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:45:57.161201 15099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:57.161993 15099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:57.166603 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:57.157467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37527 (local address 127.0.0.1:35431)
0810 01:45:57.157561 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:57.157565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:57.158820 (+ 1255us) server_negotiation.cc:407] Connection header received
0810 01:45:57.159201 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:57.159204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:57.159243 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:57.159318 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:57.160018 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:57.160511 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:57.161373 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:57.161712 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:57.161822 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:57.163387 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:57.163391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:57.163393 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:45:57.163419 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:57.164866 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:57.165326 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:57.165329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:57.165330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:57.165404 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:45:57.165713 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:45:57.165715 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:45:57.165717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:45:57.165878 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:57.166008 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:57.166346 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 01:45:57.166448 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 01:45:57.168346 15099 catalog_manager.cc:1347] Generated new cluster ID: d8b567da456c451c8f354b2eae9d0a66
I20260810 01:45:57.168409 15099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:57.179271 15099 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:45:57.180480 15099 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:57.189504 15099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2166587582134880a35d9891a31bab04: Generated new TSK 0
I20260810 01:45:57.190200 15099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:45:57.198521 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 14964
W20260810 01:45:57.217280 14945 connection.cc:535] client connection to 127.0.0.1:35431 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35431): Connection reset by peer (error 104)
2026-08-10T01:45:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1485 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:45:57 dist-test-slave-jlzn krb5kdc[15123](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:45:57 dist-test-slave-jlzn krb5kdc[15123](info): set up 2 sockets
Aug 10 01:45:57 dist-test-slave-jlzn krb5kdc[15123](info): commencing operation
krb5kdc: starting...
W20260810 01:45:58.329917 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:45:58 dist-test-slave-jlzn krb5kdc[15123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:45:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:45:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:45:58.448421 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37109
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:45:58.558802 15143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:45:58.559069 15143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:45:58.559128 15143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:45:58.563050 15143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:45:58.563109 15143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:45:58.563134 15143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:45:58.563155 15143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:45:58.563175 15143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:45:58.568316 15143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37109
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:45:58.569337 15143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:45:58.570310 15143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:45:58.578648 15152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:58.578601 15151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:45:58.578603 15159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:45:58.578922 15143 server_base.cc:1034] running on GCE node
I20260810 01:45:58.579490 15143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:45:58.580647 15143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:45:58.581810 15143 hybrid_clock.cc:648] HybridClock initialized: now 1786326358581790 us; error 29 us; skew 500 ppm
Aug 10 01:45:58 dist-test-slave-jlzn krb5kdc[15123](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326358, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:45:58.584390 15143 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:45:58.585215 15143 webserver.cc:460] Webserver started at http://127.0.0.1:45577/ using document root <none> and password file <none>
I20260810 01:45:58.585726 15143 fs_manager.cc:359] Metadata directory not provided
I20260810 01:45:58.585793 15143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:45:58.585980 15143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:45:58.587968 15143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "eaa21936c2b94faea6027a9859bbb56a"
format_stamp: "Formatted at 2026-08-10 01:45:58 on dist-test-slave-jlzn"
server_key: "33500ff563d99f9cbab7e62dd43e7307"
server_key_iv: "00621e9f81d2e7c8145a3589729577ce"
server_key_version: "encryptionkey@0"
I20260810 01:45:58.588528 15143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "eaa21936c2b94faea6027a9859bbb56a"
format_stamp: "Formatted at 2026-08-10 01:45:58 on dist-test-slave-jlzn"
server_key: "33500ff563d99f9cbab7e62dd43e7307"
server_key_iv: "00621e9f81d2e7c8145a3589729577ce"
server_key_version: "encryptionkey@0"
I20260810 01:45:58.592003 15143 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:45:58.594270 15172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:45:58.595356 15143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:45:58.595468 15143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "eaa21936c2b94faea6027a9859bbb56a"
format_stamp: "Formatted at 2026-08-10 01:45:58 on dist-test-slave-jlzn"
server_key: "33500ff563d99f9cbab7e62dd43e7307"
server_key_iv: "00621e9f81d2e7c8145a3589729577ce"
server_key_version: "encryptionkey@0"
I20260810 01:45:58.595556 15143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:45:58.610987 15143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:45:58.613956 15143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:45:58.614141 15143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:45:58.620887 15143 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37109
I20260810 01:45:58.620935 15245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37109 every 8 connection(s)
I20260810 01:45:58.621840 15143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:45:58.624250 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 15143
I20260810 01:45:58.624383 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:45:58.624673 16617 external_mini_cluster.cc:1428] Setting key 197a25df49f3b5b6909dcc07fe14592d
I20260810 01:45:58.624680 15246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:45:58.631238 15246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a: Bootstrap starting.
I20260810 01:45:58.633536 15246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a: Neither blocks nor log segments found. Creating new log.
I20260810 01:45:58.633925 15251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:58.626058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43823 (local address 127.0.0.1:37109)
0810 01:45:58.626510 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:58.626525 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:58.626561 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:45:58.627390 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:58.627410 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:58.627752 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:58.628106 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:58.628626 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:58.629687 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:58.630608 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:58.631103 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:58.631254 (+ 151us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:58.632163 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:58.632168 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:58.632180 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:58.632556 (+ 376us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:58.632612 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:58.632634 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:58.632901 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:58.633078 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 01:45:58.633211 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":149,"threads_started":1}
I20260810 01:45:58.634282 15246 log.cc:824] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a: Log is configured to *not* fsync() on all Append() calls
I20260810 01:45:58.636220 15246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a: No bootstrap required, opened a new log
I20260810 01:45:58.636691 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:45:58.640604 15246 raft_consensus.cc:348] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa21936c2b94faea6027a9859bbb56a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37109 } }
I20260810 01:45:58.640887 15246 raft_consensus.cc:374] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:45:58.640944 15246 raft_consensus.cc:729] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa21936c2b94faea6027a9859bbb56a, State: Initialized, Role: FOLLOWER
I20260810 01:45:58.641376 15246 consensus_queue.cc:260] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa21936c2b94faea6027a9859bbb56a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37109 } }
I20260810 01:45:58.641516 15246 raft_consensus.cc:388] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:45:58.641588 15246 raft_consensus.cc:482] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:45:58.641691 15246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:45:58.642707 15251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:45:58.638701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39955 (local address 127.0.0.1:37109)
0810 01:45:58.638796 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0810 01:45:58.638799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:45:58.639013 (+ 214us) server_negotiation.cc:407] Connection header received
0810 01:45:58.639133 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:45:58.639135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:45:58.639173 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:45:58.639240 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:45:58.639572 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:58.640092 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:58.641181 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:45:58.641431 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:45:58.641527 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:45:58.642300 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:45:58.642303 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:45:58.642305 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:45:58.642315 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:45:58.642339 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:45:58.642349 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:45:58.642411 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 01:45:58.642560 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 01:45:58.642586 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 01:45:58.642788 15246 raft_consensus.cc:504] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa21936c2b94faea6027a9859bbb56a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37109 } }
I20260810 01:45:58.643218 15246 leader_election.cc:302] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eaa21936c2b94faea6027a9859bbb56a; no voters:
I20260810 01:45:58.643563 15246 leader_election.cc:288] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:45:58.643646 15263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:45:58.643862 15263 raft_consensus.cc:686] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [term 1 LEADER]: Becoming Leader. State: Replica: eaa21936c2b94faea6027a9859bbb56a, State: Running, Role: LEADER
I20260810 01:45:58.644183 15263 consensus_queue.cc:237] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa21936c2b94faea6027a9859bbb56a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37109 } }
I20260810 01:45:58.644829 15246 sys_catalog.cc:564] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:45:58.645349 15263 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [sys.catalog]: SysCatalogTable state changed. Reason: New leader eaa21936c2b94faea6027a9859bbb56a. Latest consensus state: current_term: 1 leader_uuid: "eaa21936c2b94faea6027a9859bbb56a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa21936c2b94faea6027a9859bbb56a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37109 } } }
I20260810 01:45:58.645545 15263 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [sys.catalog]: This master's current role is: LEADER
I20260810 01:45:58.645758 15268 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eaa21936c2b94faea6027a9859bbb56a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaa21936c2b94faea6027a9859bbb56a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37109 } } }
I20260810 01:45:58.645879 15268 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a [sys.catalog]: This master's current role is: LEADER
W20260810 01:45:58.649777 15297 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:45:58.649902 15297 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:45:58.650005 15280 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:45:58.650700 15280 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:45:58.656332 15280 catalog_manager.cc:1347] Generated new cluster ID: 7c5de2ed4262478b86d384705dcd4f1e
I20260810 01:45:58.656395 15280 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:45:58.672717 15280 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:45:58.673595 15280 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:45:58.682248 15280 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eaa21936c2b94faea6027a9859bbb56a: Generated new TSK 0
I20260810 01:45:58.682886 15280 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:45:58.687969 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 15143
W20260810 01:45:58.698105 15119 connection.cc:535] client connection to 127.0.0.1:37109 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37109): Connection reset by peer (error 104)
2026-08-10T01:45:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1480 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:45:58 dist-test-slave-jlzn krb5kdc[15307](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:45:58 dist-test-slave-jlzn krb5kdc[15307](info): set up 2 sockets
Aug 10 01:45:58 dist-test-slave-jlzn krb5kdc[15307](info): commencing operation
krb5kdc: starting...
W20260810 01:45:59.830111 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:45:59 dist-test-slave-jlzn krb5kdc[15307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326359, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:45:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:45:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:45:59.946641 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44859
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:00.056330 15327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:00.056589 15327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:00.056632 15327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:00.060611 15327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:00.060667 15327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:00.060684 15327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:00.060714 15327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:00.060741 15327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:00.066102 15327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44859
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:00.067104 15327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:00.068109 15327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:00.076376 15337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:00.076392 15333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:00.076392 15334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:00.076444 15327 server_base.cc:1034] running on GCE node
I20260810 01:46:00.077118 15327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:00.078159 15327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:00.079320 15327 hybrid_clock.cc:648] HybridClock initialized: now 1786326360079310 us; error 28 us; skew 500 ppm
Aug 10 01:46:00 dist-test-slave-jlzn krb5kdc[15307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326360, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:00.081967 15327 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:00.082799 15327 webserver.cc:460] Webserver started at http://127.0.0.1:43569/ using document root <none> and password file <none>
I20260810 01:46:00.083313 15327 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:00.083372 15327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:00.083545 15327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:00.085574 15327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "f48caf3b26904e4db68d8d86e63ca3bc"
format_stamp: "Formatted at 2026-08-10 01:46:00 on dist-test-slave-jlzn"
server_key: "7270d610691e4bee982057b9fcb4e7d8"
server_key_iv: "c4ba69b3ef7cb518b64356c1cb3c675c"
server_key_version: "encryptionkey@0"
I20260810 01:46:00.086079 15327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "f48caf3b26904e4db68d8d86e63ca3bc"
format_stamp: "Formatted at 2026-08-10 01:46:00 on dist-test-slave-jlzn"
server_key: "7270d610691e4bee982057b9fcb4e7d8"
server_key_iv: "c4ba69b3ef7cb518b64356c1cb3c675c"
server_key_version: "encryptionkey@0"
I20260810 01:46:00.089584 15327 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:46:00.091797 15346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:00.092942 15327 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:46:00.093046 15327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "f48caf3b26904e4db68d8d86e63ca3bc"
format_stamp: "Formatted at 2026-08-10 01:46:00 on dist-test-slave-jlzn"
server_key: "7270d610691e4bee982057b9fcb4e7d8"
server_key_iv: "c4ba69b3ef7cb518b64356c1cb3c675c"
server_key_version: "encryptionkey@0"
I20260810 01:46:00.093152 15327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:00.097590 15327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:00.100262 15327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:00.100423 15327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:00.107182 15327 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44859
I20260810 01:46:00.107189 15422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44859 every 8 connection(s)
I20260810 01:46:00.108093 15327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:00.110721 15423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:00.112305 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 15327
I20260810 01:46:00.112423 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:00.112682 16617 external_mini_cluster.cc:1428] Setting key 585afc3a433461c4b20a7d93d69ecdf2
I20260810 01:46:00.117337 15423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc: Bootstrap starting.
I20260810 01:46:00.118007 15426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:00.113969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35925 (local address 127.0.0.1:44859)
0810 01:46:00.114386 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:00.114406 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:00.114448 (+ 42us) server_negotiation.cc:407] Connection header received
0810 01:46:00.115269 (+ 821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:00.115293 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:00.115653 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:00.116032 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:00.116640 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:00.116645 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:00.116660 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:00.116670 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:00.116727 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:00.116752 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:00.116881 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:00.116944 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 01:46:00.117083 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":108,"threads_started":1}
I20260810 01:46:00.119850 15423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:00.120733 15423 log.cc:824] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:00.120786 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:00.122663 15423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc: No bootstrap required, opened a new log
I20260810 01:46:00.124213 15426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:00.122836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58231 (local address 127.0.0.1:44859)
0810 01:46:00.122934 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:00.122938 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:00.123045 (+ 107us) server_negotiation.cc:407] Connection header received
0810 01:46:00.123125 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:00.123128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:00.123163 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:00.123236 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:00.123869 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:00.123873 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:00.123875 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:00.123887 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:00.123917 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:00.123929 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:00.124015 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:00.124064 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 01:46:00.124098 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 01:46:00.126544 15423 raft_consensus.cc:348] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48caf3b26904e4db68d8d86e63ca3bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44859 } }
I20260810 01:46:00.126754 15423 raft_consensus.cc:374] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:00.126796 15423 raft_consensus.cc:729] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f48caf3b26904e4db68d8d86e63ca3bc, State: Initialized, Role: FOLLOWER
I20260810 01:46:00.127146 15423 consensus_queue.cc:260] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48caf3b26904e4db68d8d86e63ca3bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44859 } }
I20260810 01:46:00.127255 15423 raft_consensus.cc:388] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:00.127298 15423 raft_consensus.cc:482] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:00.127364 15423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:00.128229 15423 raft_consensus.cc:504] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48caf3b26904e4db68d8d86e63ca3bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44859 } }
I20260810 01:46:00.128515 15423 leader_election.cc:302] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f48caf3b26904e4db68d8d86e63ca3bc; no voters:
I20260810 01:46:00.128758 15423 leader_election.cc:288] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:00.128860 15435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:00.129056 15435 raft_consensus.cc:686] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [term 1 LEADER]: Becoming Leader. State: Replica: f48caf3b26904e4db68d8d86e63ca3bc, State: Running, Role: LEADER
I20260810 01:46:00.129423 15435 consensus_queue.cc:237] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48caf3b26904e4db68d8d86e63ca3bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44859 } }
I20260810 01:46:00.129812 15423 sys_catalog.cc:564] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:00.131229 15437 sys_catalog.cc:455] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader f48caf3b26904e4db68d8d86e63ca3bc. Latest consensus state: current_term: 1 leader_uuid: "f48caf3b26904e4db68d8d86e63ca3bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48caf3b26904e4db68d8d86e63ca3bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44859 } } }
I20260810 01:46:00.131560 15437 sys_catalog.cc:458] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:00.131443 15436 sys_catalog.cc:455] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f48caf3b26904e4db68d8d86e63ca3bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48caf3b26904e4db68d8d86e63ca3bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44859 } } }
I20260810 01:46:00.131706 15436 sys_catalog.cc:458] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc [sys.catalog]: This master's current role is: LEADER
W20260810 01:46:00.134642 15457 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:00.134756 15457 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:00.134858 15458 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:00.135776 15458 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:00.141021 15458 catalog_manager.cc:1347] Generated new cluster ID: 95bda21544c24e10a1f6993354472182
I20260810 01:46:00.141085 15458 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:00.152920 15458 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:00.153219 15458 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:00.166863 15458 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f48caf3b26904e4db68d8d86e63ca3bc: Generated new TSK 0
I20260810 01:46:00.167644 15458 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:00.173040 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 15327
2026-08-10T01:46:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1488 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:00 dist-test-slave-jlzn krb5kdc[15475](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:00 dist-test-slave-jlzn krb5kdc[15475](info): set up 2 sockets
Aug 10 01:46:00 dist-test-slave-jlzn krb5kdc[15475](info): commencing operation
krb5kdc: starting...
W20260810 01:46:01.311653 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:01 dist-test-slave-jlzn krb5kdc[15475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:46:01.432127 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36641
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:01.541827 15495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:01.542079 15495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:01.542137 15495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:01.546041 15495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:01.546095 15495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:01.546123 15495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:01.546144 15495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:01.546168 15495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:01.551230 15495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:01.552223 15495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:01.553203 15495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:01.561409 15508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:01.561604 15503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:01.561600 15505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:01.561748 15495 server_base.cc:1034] running on GCE node
I20260810 01:46:01.562283 15495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:01.563284 15495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:01.564442 15495 hybrid_clock.cc:648] HybridClock initialized: now 1786326361564417 us; error 36 us; skew 500 ppm
Aug 10 01:46:01 dist-test-slave-jlzn krb5kdc[15475](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326361, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:01.566985 15495 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:01.567934 15495 webserver.cc:460] Webserver started at http://127.0.0.1:33233/ using document root <none> and password file <none>
I20260810 01:46:01.568461 15495 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:01.568523 15495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:01.568696 15495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:01.570659 15495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "27760e11a742427eae0bb5fe2c566660"
format_stamp: "Formatted at 2026-08-10 01:46:01 on dist-test-slave-jlzn"
server_key: "dd4c8ee0986fa003886d7228282e0641"
server_key_iv: "5caa4df676fff36362cf445d47d705e0"
server_key_version: "encryptionkey@0"
I20260810 01:46:01.571197 15495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "27760e11a742427eae0bb5fe2c566660"
format_stamp: "Formatted at 2026-08-10 01:46:01 on dist-test-slave-jlzn"
server_key: "dd4c8ee0986fa003886d7228282e0641"
server_key_iv: "5caa4df676fff36362cf445d47d705e0"
server_key_version: "encryptionkey@0"
I20260810 01:46:01.574716 15495 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:46:01.577059 15519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:01.578176 15495 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:46:01.578279 15495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "27760e11a742427eae0bb5fe2c566660"
format_stamp: "Formatted at 2026-08-10 01:46:01 on dist-test-slave-jlzn"
server_key: "dd4c8ee0986fa003886d7228282e0641"
server_key_iv: "5caa4df676fff36362cf445d47d705e0"
server_key_version: "encryptionkey@0"
I20260810 01:46:01.578358 15495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:01.597117 15495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:01.599581 15495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:01.599722 15495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:01.606247 15495 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36641
I20260810 01:46:01.606266 15611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36641 every 8 connection(s)
I20260810 01:46:01.607102 15495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:01.607602 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 15495
I20260810 01:46:01.607754 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:01.608038 16617 external_mini_cluster.cc:1428] Setting key f766a4cab2458a29a247580202042c6b
I20260810 01:46:01.610062 15612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:01.615315 15612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660: Bootstrap starting.
Aug 10 01:46:01 dist-test-slave-jlzn krb5kdc[15475](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 01:46:01.617535 15612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:01.618258 15612 log.cc:824] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:01.620404 15612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660: No bootstrap required, opened a new log
I20260810 01:46:01.621337 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:01.609354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33847 (local address 127.0.0.1:36641)
0810 01:46:01.609790 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:01.609803 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:01.609838 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:46:01.610485 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:01.610504 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:01.610820 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:01.611107 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:01.611918 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:01.612894 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:01.613751 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:01.614212 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:01.614351 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:01.616735 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:01.616740 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:01.616751 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:01.616777 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:01.618355 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:01.618819 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:01.618824 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:01.618828 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:01.618939 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:01.619231 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:01.619234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:01.619236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:01.619705 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:01.619929 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:01.620152 (+ 223us) server_negotiation.cc:299] Negotiation successful
0810 01:46:01.620443 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":148,"threads_started":1}
I20260810 01:46:01.624110 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:01.624471 15612 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27760e11a742427eae0bb5fe2c566660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36641 } }
I20260810 01:46:01.624744 15612 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:01.624801 15612 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27760e11a742427eae0bb5fe2c566660, State: Initialized, Role: FOLLOWER
I20260810 01:46:01.625245 15612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27760e11a742427eae0bb5fe2c566660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36641 } }
I20260810 01:46:01.625407 15612 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:01.625532 15612 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:01.625662 15612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:01.626677 15612 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27760e11a742427eae0bb5fe2c566660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36641 } }
I20260810 01:46:01.627009 15612 leader_election.cc:302] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27760e11a742427eae0bb5fe2c566660; no voters:
I20260810 01:46:01.627298 15612 leader_election.cc:288] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:01.627415 15626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:01.627650 15626 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [term 1 LEADER]: Becoming Leader. State: Replica: 27760e11a742427eae0bb5fe2c566660, State: Running, Role: LEADER
I20260810 01:46:01.628001 15626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27760e11a742427eae0bb5fe2c566660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36641 } }
I20260810 01:46:01.628504 15612 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:01.629180 15626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27760e11a742427eae0bb5fe2c566660. Latest consensus state: current_term: 1 leader_uuid: "27760e11a742427eae0bb5fe2c566660" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27760e11a742427eae0bb5fe2c566660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36641 } } }
I20260810 01:46:01.629359 15626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:01.629771 15637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:01.631961 15628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27760e11a742427eae0bb5fe2c566660" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27760e11a742427eae0bb5fe2c566660" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36641 } } }
I20260810 01:46:01.632118 15628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:01.632880 15637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:01.634665 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:01.626358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52199 (local address 127.0.0.1:36641)
0810 01:46:01.626465 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:01.626469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:01.626592 (+ 123us) server_negotiation.cc:407] Connection header received
0810 01:46:01.626674 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:01.626677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:01.626723 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:01.626799 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:01.627475 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:01.628227 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:01.629358 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:01.629697 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:01.629790 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:01.631350 (+ 1560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:01.631353 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:01.631356 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:01.631380 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:01.632998 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:01.633461 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:01.633464 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:01.633465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:01.633555 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:01.633873 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:01.633876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:01.633878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:01.634056 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:01.634180 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:01.634407 (+ 227us) server_negotiation.cc:299] Negotiation successful
0810 01:46:01.634523 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:46:01.638388 15637 catalog_manager.cc:1347] Generated new cluster ID: 7280bdfcea634d68b8dd039252bc39ba
I20260810 01:46:01.638438 15637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:01.657588 15637 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:01.658839 15637 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:01.668295 15637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27760e11a742427eae0bb5fe2c566660: Generated new TSK 0
I20260810 01:46:01.669122 15637 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:01.677450 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 15495
2026-08-10T01:46:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1504 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:01 dist-test-slave-jlzn krb5kdc[15654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:01 dist-test-slave-jlzn krb5kdc[15654](info): set up 2 sockets
Aug 10 01:46:01 dist-test-slave-jlzn krb5kdc[15654](info): commencing operation
krb5kdc: starting...
W20260810 01:46:02.812831 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:02 dist-test-slave-jlzn krb5kdc[15654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:46:02.930780 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43591
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43591
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:03.039781 15680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:03.040092 15680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:03.040158 15680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:03.044096 15680 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:03.044158 15680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:03.044185 15680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:03.044221 15680 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:03.044252 15680 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:03.049505 15680 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15680
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:03.050493 15680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:03.051473 15680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:03.059700 15688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:03.059861 15680 server_base.cc:1034] running on GCE node
W20260810 01:46:03.059727 15687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:03.059724 15691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:03.060485 15680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:03.061517 15680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:03.062682 15680 hybrid_clock.cc:648] HybridClock initialized: now 1786326363062663 us; error 29 us; skew 500 ppm
Aug 10 01:46:03 dist-test-slave-jlzn krb5kdc[15654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326363, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:03.067900 15680 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:03.068755 15680 webserver.cc:460] Webserver started at http://127.0.0.1:43211/ using document root <none> and password file <none>
I20260810 01:46:03.069283 15680 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:03.069350 15680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:03.069536 15680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:03.071509 15680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "799ae2f399304da48fce49f8bd7d6008"
format_stamp: "Formatted at 2026-08-10 01:46:03 on dist-test-slave-jlzn"
server_key: "f70b9d8f0dd7ea7cfbfc816b4c36864b"
server_key_iv: "d1112751fb52ffb9b3629fd63fb243b8"
server_key_version: "encryptionkey@0"
I20260810 01:46:03.072064 15680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "799ae2f399304da48fce49f8bd7d6008"
format_stamp: "Formatted at 2026-08-10 01:46:03 on dist-test-slave-jlzn"
server_key: "f70b9d8f0dd7ea7cfbfc816b4c36864b"
server_key_iv: "d1112751fb52ffb9b3629fd63fb243b8"
server_key_version: "encryptionkey@0"
I20260810 01:46:03.075477 15680 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:46:03.077795 15704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:03.078900 15680 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:46:03.079013 15680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "799ae2f399304da48fce49f8bd7d6008"
format_stamp: "Formatted at 2026-08-10 01:46:03 on dist-test-slave-jlzn"
server_key: "f70b9d8f0dd7ea7cfbfc816b4c36864b"
server_key_iv: "d1112751fb52ffb9b3629fd63fb243b8"
server_key_version: "encryptionkey@0"
I20260810 01:46:03.079105 15680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:03.100551 15680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:03.102972 15680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:03.103142 15680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:03.110054 15680 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43591
I20260810 01:46:03.110069 15793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43591 every 8 connection(s)
I20260810 01:46:03.110947 15680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:03.113607 15795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:03.116309 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 15680
I20260810 01:46:03.116460 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:03.116767 16617 external_mini_cluster.cc:1428] Setting key dd21b7a527fdc056d1d6ab41661cac61
I20260810 01:46:03.119474 15795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008: Bootstrap starting.
I20260810 01:46:03.121923 15795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:03.122699 15795 log.cc:824] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:03.124785 15795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008: No bootstrap required, opened a new log
I20260810 01:46:03.125275 15801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:03.118045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50321 (local address 127.0.0.1:43591)
0810 01:46:03.118466 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:03.118481 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:03.118517 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:46:03.119108 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:03.119123 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:03.119446 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:03.119738 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:03.120089 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:03.121030 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:03.122189 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:03.122646 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:03.122757 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:03.123615 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:03.123620 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:03.123641 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:03.124035 (+ 394us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:03.124090 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:03.124113 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:03.124187 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:03.124333 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 01:46:03.124517 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":110,"threads_started":1}
I20260810 01:46:03.127868 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:03.128356 15795 raft_consensus.cc:348] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799ae2f399304da48fce49f8bd7d6008" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43591 } }
I20260810 01:46:03.128640 15795 raft_consensus.cc:374] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:03.128701 15795 raft_consensus.cc:729] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 799ae2f399304da48fce49f8bd7d6008, State: Initialized, Role: FOLLOWER
I20260810 01:46:03.129158 15795 consensus_queue.cc:260] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799ae2f399304da48fce49f8bd7d6008" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43591 } }
I20260810 01:46:03.129335 15795 raft_consensus.cc:388] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:03.129410 15795 raft_consensus.cc:482] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:03.129511 15795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:03.130563 15795 raft_consensus.cc:504] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799ae2f399304da48fce49f8bd7d6008" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43591 } }
I20260810 01:46:03.130934 15795 leader_election.cc:302] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 799ae2f399304da48fce49f8bd7d6008; no voters:
I20260810 01:46:03.131235 15795 leader_election.cc:288] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:03.131330 15810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:03.131551 15810 raft_consensus.cc:686] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [term 1 LEADER]: Becoming Leader. State: Replica: 799ae2f399304da48fce49f8bd7d6008, State: Running, Role: LEADER
I20260810 01:46:03.131964 15810 consensus_queue.cc:237] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799ae2f399304da48fce49f8bd7d6008" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43591 } }
I20260810 01:46:03.132447 15795 sys_catalog.cc:564] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:03.133581 15815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 799ae2f399304da48fce49f8bd7d6008. Latest consensus state: current_term: 1 leader_uuid: "799ae2f399304da48fce49f8bd7d6008" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799ae2f399304da48fce49f8bd7d6008" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43591 } } }
I20260810 01:46:03.133708 15815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:03.134048 15813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "799ae2f399304da48fce49f8bd7d6008" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799ae2f399304da48fce49f8bd7d6008" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43591 } } }
I20260810 01:46:03.134162 15813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:03.134135 15823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:03.134590 15801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:03.130146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52575 (local address 127.0.0.1:43591)
0810 01:46:03.130253 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:03.130257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:03.130342 (+ 85us) server_negotiation.cc:407] Connection header received
0810 01:46:03.130473 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:03.130475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:03.130509 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:03.130567 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:03.130851 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:03.131467 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:03.132638 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:03.132973 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:03.133066 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:03.133990 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:03.133994 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:03.133997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:03.134011 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:03.134039 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:03.134052 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:03.134112 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:03.134419 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 01:46:03.134473 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:46:03.137842 15823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:03.142903 15823 catalog_manager.cc:1347] Generated new cluster ID: bb010bd76d3f42e7929b8fe412ef46fc
I20260810 01:46:03.142966 15823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:03.158655 15823 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:03.159547 15823 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:03.163997 15823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 799ae2f399304da48fce49f8bd7d6008: Generated new TSK 0
I20260810 01:46:03.164582 15823 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:03.169893 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 15680
2026-08-10T01:46:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:03 dist-test-slave-jlzn krb5kdc[15838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:03 dist-test-slave-jlzn krb5kdc[15838](info): set up 2 sockets
Aug 10 01:46:03 dist-test-slave-jlzn krb5kdc[15838](info): commencing operation
krb5kdc: starting...
W20260810 01:46:04.305336 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:04 dist-test-slave-jlzn krb5kdc[15838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:46:04.420260 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44891
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:04.527751 15860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:04.528004 15860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:04.528045 15860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:04.531927 15860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:04.531978 15860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:04.531998 15860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:04.532027 15860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:04.532047 15860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:04.537114 15860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:04.538028 15860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:04.538970 15860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:04.546936 15865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:04.547010 15860 server_base.cc:1034] running on GCE node
W20260810 01:46:04.546927 15866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:04.546932 15868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:04.547629 15860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:04.548655 15860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:04.549816 15860 hybrid_clock.cc:648] HybridClock initialized: now 1786326364549806 us; error 26 us; skew 500 ppm
Aug 10 01:46:04 dist-test-slave-jlzn krb5kdc[15838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326364, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:04.552451 15860 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:04.553264 15860 webserver.cc:460] Webserver started at http://127.0.0.1:36161/ using document root <none> and password file <none>
I20260810 01:46:04.553781 15860 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:04.553846 15860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:04.554041 15860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:04.556033 15860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "19df4f0be4c648838db31bdf07862e5f"
format_stamp: "Formatted at 2026-08-10 01:46:04 on dist-test-slave-jlzn"
server_key: "736021ad0693957b61d68a41a1712a18"
server_key_iv: "dc92ab5c5101b3b5bf92b2377823b9cf"
server_key_version: "encryptionkey@0"
I20260810 01:46:04.556581 15860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "19df4f0be4c648838db31bdf07862e5f"
format_stamp: "Formatted at 2026-08-10 01:46:04 on dist-test-slave-jlzn"
server_key: "736021ad0693957b61d68a41a1712a18"
server_key_iv: "dc92ab5c5101b3b5bf92b2377823b9cf"
server_key_version: "encryptionkey@0"
I20260810 01:46:04.560024 15860 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 01:46:04.562252 15879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:04.563346 15860 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:46:04.563458 15860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "19df4f0be4c648838db31bdf07862e5f"
format_stamp: "Formatted at 2026-08-10 01:46:04 on dist-test-slave-jlzn"
server_key: "736021ad0693957b61d68a41a1712a18"
server_key_iv: "dc92ab5c5101b3b5bf92b2377823b9cf"
server_key_version: "encryptionkey@0"
I20260810 01:46:04.563546 15860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:04.567831 15860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:04.570401 15860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:04.570564 15860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:04.576946 15860 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44891
I20260810 01:46:04.576988 15974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44891 every 8 connection(s)
I20260810 01:46:04.577783 15860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:04.580446 15977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:04.585551 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 15860
I20260810 01:46:04.585697 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:04.585737 15977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f: Bootstrap starting.
I20260810 01:46:04.585997 16617 external_mini_cluster.cc:1428] Setting key 594a0b872cb9bf514bfca06b8b5b0032
I20260810 01:46:04.588164 15977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:04.588893 15977 log.cc:824] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:04.590665 15981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:04.587181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38427 (local address 127.0.0.1:44891)
0810 01:46:04.587569 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:04.587582 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:04.587617 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:46:04.588298 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:04.588317 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:04.588579 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:04.588845 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:04.589545 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:04.589550 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:04.589566 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:04.589578 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:04.589657 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:04.589687 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:04.589800 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:04.589895 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 01:46:04.590027 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":110,"threads_started":1}
I20260810 01:46:04.591125 15977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f: No bootstrap required, opened a new log
I20260810 01:46:04.593374 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:04.595063 15977 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19df4f0be4c648838db31bdf07862e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } }
I20260810 01:46:04.595372 15977 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:04.595439 15977 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19df4f0be4c648838db31bdf07862e5f, State: Initialized, Role: FOLLOWER
I20260810 01:46:04.595870 15977 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19df4f0be4c648838db31bdf07862e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } }
I20260810 01:46:04.596033 15977 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:04.596108 15977 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:04.596215 15977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:04.597112 15977 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19df4f0be4c648838db31bdf07862e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } }
I20260810 01:46:04.597332 15981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:04.595256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44885 (local address 127.0.0.1:44891)
0810 01:46:04.595350 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:04.595354 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:04.596069 (+ 715us) server_negotiation.cc:407] Connection header received
0810 01:46:04.596244 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:04.596247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:04.596285 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:04.596358 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:04.596987 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:04.596990 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:04.596993 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:04.597004 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:04.597034 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:04.597046 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:04.597150 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:04.597190 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 01:46:04.597228 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 01:46:04.597461 15977 leader_election.cc:302] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19df4f0be4c648838db31bdf07862e5f; no voters:
I20260810 01:46:04.597760 15977 leader_election.cc:288] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:04.597841 15991 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:04.598042 15991 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [term 1 LEADER]: Becoming Leader. State: Replica: 19df4f0be4c648838db31bdf07862e5f, State: Running, Role: LEADER
I20260810 01:46:04.598357 15991 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19df4f0be4c648838db31bdf07862e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } }
I20260810 01:46:04.598891 15977 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:04.599400 15991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19df4f0be4c648838db31bdf07862e5f. Latest consensus state: current_term: 1 leader_uuid: "19df4f0be4c648838db31bdf07862e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19df4f0be4c648838db31bdf07862e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } } }
I20260810 01:46:04.599512 15991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:04.599964 15994 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19df4f0be4c648838db31bdf07862e5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19df4f0be4c648838db31bdf07862e5f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44891 } } }
I20260810 01:46:04.600032 15999 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:04.600106 15994 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:04.603713 15999 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:04.608696 15999 catalog_manager.cc:1347] Generated new cluster ID: 3a95390eb0d84bdc815a9e8a475620b0
I20260810 01:46:04.608758 15999 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:04.616134 15999 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:04.616427 15999 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:04.623569 15999 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19df4f0be4c648838db31bdf07862e5f: Generated new TSK 0
I20260810 01:46:04.624271 15999 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:04.633253 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 15860
2026-08-10T01:46:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1462 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:04 dist-test-slave-jlzn krb5kdc[16019](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:04 dist-test-slave-jlzn krb5kdc[16019](info): set up 2 sockets
Aug 10 01:46:04 dist-test-slave-jlzn krb5kdc[16019](info): commencing operation
krb5kdc: starting...
W20260810 01:46:05.761579 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:05 dist-test-slave-jlzn krb5kdc[16019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:46:05.875797 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37353
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:05.985146 16039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:05.985409 16039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:05.985463 16039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:05.989473 16039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:05.989552 16039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:05.989580 16039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:05.989630 16039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:05.989663 16039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:05.994835 16039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:05.995829 16039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:05.996807 16039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:06.004863 16055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:06.004874 16057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:06.005080 16039 server_base.cc:1034] running on GCE node
W20260810 01:46:06.004905 16051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:06.005741 16039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:06.006778 16039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:06.007929 16039 hybrid_clock.cc:648] HybridClock initialized: now 1786326366007916 us; error 25 us; skew 500 ppm
Aug 10 01:46:06 dist-test-slave-jlzn krb5kdc[16019](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326366, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:06.010560 16039 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:06.011399 16039 webserver.cc:460] Webserver started at http://127.0.0.1:35189/ using document root <none> and password file <none>
I20260810 01:46:06.011983 16039 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:06.012053 16039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:06.012251 16039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:06.014273 16039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "2d7f4706e21440c5a7b7050560d20047"
format_stamp: "Formatted at 2026-08-10 01:46:06 on dist-test-slave-jlzn"
server_key: "00714434874819f2b1980c4b4d4e3a63"
server_key_iv: "35aceb254f032324ca35dfcd16eec3c6"
server_key_version: "encryptionkey@0"
I20260810 01:46:06.014817 16039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "2d7f4706e21440c5a7b7050560d20047"
format_stamp: "Formatted at 2026-08-10 01:46:06 on dist-test-slave-jlzn"
server_key: "00714434874819f2b1980c4b4d4e3a63"
server_key_iv: "35aceb254f032324ca35dfcd16eec3c6"
server_key_version: "encryptionkey@0"
I20260810 01:46:06.018396 16039 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:46:06.020754 16065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:06.021912 16039 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:46:06.022027 16039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "2d7f4706e21440c5a7b7050560d20047"
format_stamp: "Formatted at 2026-08-10 01:46:06 on dist-test-slave-jlzn"
server_key: "00714434874819f2b1980c4b4d4e3a63"
server_key_iv: "35aceb254f032324ca35dfcd16eec3c6"
server_key_version: "encryptionkey@0"
I20260810 01:46:06.022116 16039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:06.031697 16039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:06.034170 16039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:06.034330 16039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:06.040891 16039 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37353
I20260810 01:46:06.040920 16145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37353 every 8 connection(s)
I20260810 01:46:06.041774 16039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:06.044540 16146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:06.049975 16146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047: Bootstrap starting.
I20260810 01:46:06.051019 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 16039
I20260810 01:46:06.051131 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:06.051373 16617 external_mini_cluster.cc:1428] Setting key 2a5b6e1ead6233d89bb2266167641049
I20260810 01:46:06.052729 16146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:06.053601 16146 log.cc:824] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:06.055701 16146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047: No bootstrap required, opened a new log
I20260810 01:46:06.059552 16146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d7f4706e21440c5a7b7050560d20047" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37353 } }
I20260810 01:46:06.059765 16146 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:06.059834 16146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d7f4706e21440c5a7b7050560d20047, State: Initialized, Role: FOLLOWER
Aug 10 01:46:06 dist-test-slave-jlzn krb5kdc[16019](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 01:46:06.060252 16146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d7f4706e21440c5a7b7050560d20047" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37353 } }
I20260810 01:46:06.060400 16146 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:06.060461 16146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:06.060556 16146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:06.061607 16146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d7f4706e21440c5a7b7050560d20047" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37353 } }
I20260810 01:46:06.061987 16146 leader_election.cc:302] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d7f4706e21440c5a7b7050560d20047; no voters:
I20260810 01:46:06.062355 16146 leader_election.cc:288] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:06.062434 16154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:06.062680 16154 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [term 1 LEADER]: Becoming Leader. State: Replica: 2d7f4706e21440c5a7b7050560d20047, State: Running, Role: LEADER
I20260810 01:46:06.063021 16154 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d7f4706e21440c5a7b7050560d20047" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37353 } }
I20260810 01:46:06.063555 16146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:06.064860 16155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d7f4706e21440c5a7b7050560d20047" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d7f4706e21440c5a7b7050560d20047" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37353 } } }
I20260810 01:46:06.065001 16155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:06.064875 16157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d7f4706e21440c5a7b7050560d20047. Latest consensus state: current_term: 1 leader_uuid: "2d7f4706e21440c5a7b7050560d20047" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d7f4706e21440c5a7b7050560d20047" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37353 } } }
I20260810 01:46:06.065532 16157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:06.065743 16176 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:06.067525 16151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:06.052468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:34067 (local address 127.0.0.1:37353)
0810 01:46:06.052948 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:06.052968 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:06.053013 (+ 45us) server_negotiation.cc:407] Connection header received
0810 01:46:06.053862 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:06.053896 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:06.054272 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:06.054618 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:06.055260 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:06.056726 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:06.057556 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:06.058299 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:06.058467 (+ 168us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:06.060943 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:06.060949 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:06.060965 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:06.060995 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:06.062928 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:06.063559 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:06.063565 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:06.063571 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:06.063714 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:06.064160 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:06.064164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:06.064165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:06.064725 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:06.065008 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:06.066616 (+ 1608us) server_negotiation.cc:299] Negotiation successful
0810 01:46:06.066846 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":313,"thread_start_us":148,"threads_started":1}
I20260810 01:46:06.070153 16176 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:06.070617 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:06.075287 16176 catalog_manager.cc:1347] Generated new cluster ID: a0d426f1a31345e3a9e2c77ba2b7794f
I20260810 01:46:06.075340 16176 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:06.092562 16151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:06.084230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:34239 (local address 127.0.0.1:37353)
0810 01:46:06.084339 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:06.084343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:06.084479 (+ 136us) server_negotiation.cc:407] Connection header received
0810 01:46:06.084584 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:06.084587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:06.084643 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:06.084724 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:06.085447 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:06.086250 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:06.087336 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:06.087698 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:06.087794 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:06.089259 (+ 1465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:06.089263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:06.089266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:06.089293 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:06.090823 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:06.091307 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:06.091311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:06.091313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:06.091401 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:06.091683 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:06.091686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:06.091688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:06.091914 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:06.092059 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:06.092296 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 01:46:06.092405 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:46:06.099372 16176 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:06.100257 16176 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:06.110927 16176 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d7f4706e21440c5a7b7050560d20047: Generated new TSK 0
I20260810 01:46:06.111603 16176 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:06.118185 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 16039
W20260810 01:46:06.129571 16016 connection.cc:535] client connection to 127.0.0.1:37353 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37353): Connection reset by peer (error 104)
2026-08-10T01:46:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1481 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:06 dist-test-slave-jlzn krb5kdc[16198](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:06 dist-test-slave-jlzn krb5kdc[16198](info): set up 2 sockets
Aug 10 01:46:06 dist-test-slave-jlzn krb5kdc[16198](info): commencing operation
krb5kdc: starting...
W20260810 01:46:07.255205 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:07 dist-test-slave-jlzn krb5kdc[16198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:46:07.370411 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44609
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44609
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:07.479911 16223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:07.480177 16223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:07.480235 16223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:07.484141 16223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:07.484192 16223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:07.484218 16223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:07.484239 16223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:07.484266 16223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:07.489351 16223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:07.490307 16223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:07.491281 16223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:07.499275 16229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:07.499287 16230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:07.499395 16223 server_base.cc:1034] running on GCE node
W20260810 01:46:07.499599 16233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:07.500222 16223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:07.501200 16223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:07.502353 16223 hybrid_clock.cc:648] HybridClock initialized: now 1786326367502334 us; error 29 us; skew 500 ppm
Aug 10 01:46:07 dist-test-slave-jlzn krb5kdc[16198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326367, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:07.504966 16223 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:07.505774 16223 webserver.cc:460] Webserver started at http://127.0.0.1:44619/ using document root <none> and password file <none>
I20260810 01:46:07.506282 16223 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:07.506345 16223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:07.506524 16223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:07.508471 16223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "1abc3b042a454445b4718022c1e38a33"
format_stamp: "Formatted at 2026-08-10 01:46:07 on dist-test-slave-jlzn"
server_key: "b70fc87310dc70770c5e63794bffe32b"
server_key_iv: "9b69aa92751aaae2a5405fec9512b2ce"
server_key_version: "encryptionkey@0"
I20260810 01:46:07.508991 16223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "1abc3b042a454445b4718022c1e38a33"
format_stamp: "Formatted at 2026-08-10 01:46:07 on dist-test-slave-jlzn"
server_key: "b70fc87310dc70770c5e63794bffe32b"
server_key_iv: "9b69aa92751aaae2a5405fec9512b2ce"
server_key_version: "encryptionkey@0"
I20260810 01:46:07.512445 16223 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:46:07.514679 16245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:07.515915 16223 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:46:07.516027 16223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "1abc3b042a454445b4718022c1e38a33"
format_stamp: "Formatted at 2026-08-10 01:46:07 on dist-test-slave-jlzn"
server_key: "b70fc87310dc70770c5e63794bffe32b"
server_key_iv: "9b69aa92751aaae2a5405fec9512b2ce"
server_key_version: "encryptionkey@0"
I20260810 01:46:07.516119 16223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:07.530743 16223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:07.533691 16223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:07.533859 16223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:07.540418 16223 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44609
I20260810 01:46:07.540431 16326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44609 every 8 connection(s)
I20260810 01:46:07.541343 16223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:07.544054 16328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:07.545585 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 16223
I20260810 01:46:07.545735 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:07.546023 16617 external_mini_cluster.cc:1428] Setting key 9d25e2593af65a5d2674495361d5c901
I20260810 01:46:07.550082 16328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33: Bootstrap starting.
I20260810 01:46:07.552675 16328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:07.553457 16328 log.cc:824] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:07.554503 16331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:07.547276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:52299 (local address 127.0.0.1:44609)
0810 01:46:07.547645 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:07.547660 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:07.547694 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:46:07.548336 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:07.548351 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:07.548662 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:07.548918 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:07.549266 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:07.550233 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:07.551369 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:07.551859 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:07.551978 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:07.552790 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:07.552797 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:07.552811 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:07.553190 (+ 379us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:07.553245 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:07.553268 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:07.553375 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:07.553543 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 01:46:07.553672 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":92,"threads_started":1}
I20260810 01:46:07.555426 16328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33: No bootstrap required, opened a new log
I20260810 01:46:07.557255 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:07.559199 16328 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abc3b042a454445b4718022c1e38a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44609 } }
I20260810 01:46:07.559456 16328 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:07.559518 16328 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abc3b042a454445b4718022c1e38a33, State: Initialized, Role: FOLLOWER
I20260810 01:46:07.560063 16328 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abc3b042a454445b4718022c1e38a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44609 } }
I20260810 01:46:07.560245 16328 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:07.560300 16344 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 01:46:07.560454 16344 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abc3b042a454445b4718022c1e38a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44609 } }
I20260810 01:46:07.560767 16328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:07.560765 16344 leader_election.cc:302] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1abc3b042a454445b4718022c1e38a33; no voters:
I20260810 01:46:07.560869 16328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:07.561156 16344 leader_election.cc:288] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260810 01:46:07.561857 16328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abc3b042a454445b4718022c1e38a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44609 } }
I20260810 01:46:07.562000 16328 leader_election.cc:302] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1abc3b042a454445b4718022c1e38a33; no voters:
I20260810 01:46:07.562101 16328 leader_election.cc:288] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:07.562157 16344 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:07.562379 16344 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 1 LEADER]: Becoming Leader. State: Replica: 1abc3b042a454445b4718022c1e38a33, State: Running, Role: LEADER
I20260810 01:46:07.562680 16344 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abc3b042a454445b4718022c1e38a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44609 } }
I20260810 01:46:07.563287 16328 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:07.563321 16331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:07.559141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:45135 (local address 127.0.0.1:44609)
0810 01:46:07.559250 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:07.559254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:07.559379 (+ 125us) server_negotiation.cc:407] Connection header received
0810 01:46:07.559462 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:07.559465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:07.559511 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:07.559590 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:07.559850 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:07.560516 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:07.561561 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:07.561799 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:07.561875 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:07.562715 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:07.562719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:07.562721 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:07.562734 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:07.562762 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:07.562775 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:07.562859 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:07.563170 (+ 311us) server_negotiation.cc:299] Negotiation successful
0810 01:46:07.563202 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:46:07.563892 16344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1abc3b042a454445b4718022c1e38a33. Latest consensus state: current_term: 1 leader_uuid: "1abc3b042a454445b4718022c1e38a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abc3b042a454445b4718022c1e38a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44609 } } }
I20260810 01:46:07.564092 16344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:07.564531 16358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:07.564955 16346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1abc3b042a454445b4718022c1e38a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abc3b042a454445b4718022c1e38a33" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44609 } } }
I20260810 01:46:07.565090 16346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:07.565428 16345 raft_consensus.cc:2741] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33 [term 1 LEADER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 01:46:07.567585 16358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:07.572855 16358 catalog_manager.cc:1347] Generated new cluster ID: 87212d31be124cdeaa2108fe4a7c3a56
I20260810 01:46:07.572917 16358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:07.580157 16358 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:07.580993 16358 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:07.587082 16358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1abc3b042a454445b4718022c1e38a33: Generated new TSK 0
I20260810 01:46:07.587764 16358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:07.599727 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 16223
W20260810 01:46:07.613001 16196 connection.cc:535] client connection to 127.0.0.1:44609 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44609): Connection reset by peer (error 104)
2026-08-10T01:46:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1483 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:07 dist-test-slave-jlzn krb5kdc[16377](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:07 dist-test-slave-jlzn krb5kdc[16377](info): set up 2 sockets
Aug 10 01:46:07 dist-test-slave-jlzn krb5kdc[16377](info): commencing operation
krb5kdc: starting...
W20260810 01:46:08.725543 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:08 dist-test-slave-jlzn krb5kdc[16377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:46:08.839669 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46241
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:08.947446 16395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:08.947690 16395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:08.947733 16395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:08.951607 16395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:08.951670 16395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:08.951689 16395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:08.951716 16395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:08.951745 16395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:08.956796 16395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:08.957741 16395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:08.958684 16395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:08.966722 16401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:08.966722 16404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:08.966841 16395 server_base.cc:1034] running on GCE node
W20260810 01:46:08.966739 16406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:08.967583 16395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:08.968644 16395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:08.969805 16395 hybrid_clock.cc:648] HybridClock initialized: now 1786326368969787 us; error 27 us; skew 500 ppm
Aug 10 01:46:08 dist-test-slave-jlzn krb5kdc[16377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326368, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:08.975031 16395 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:08.975911 16395 webserver.cc:460] Webserver started at http://127.0.0.1:37841/ using document root <none> and password file <none>
I20260810 01:46:08.976423 16395 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:08.976490 16395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:08.976693 16395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:08.978617 16395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae"
format_stamp: "Formatted at 2026-08-10 01:46:08 on dist-test-slave-jlzn"
server_key: "7a715246b172872a6515a050575608b9"
server_key_iv: "97bcc3364e11b3ad45900f834d0a480d"
server_key_version: "encryptionkey@0"
I20260810 01:46:08.979159 16395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae"
format_stamp: "Formatted at 2026-08-10 01:46:08 on dist-test-slave-jlzn"
server_key: "7a715246b172872a6515a050575608b9"
server_key_iv: "97bcc3364e11b3ad45900f834d0a480d"
server_key_version: "encryptionkey@0"
I20260810 01:46:08.982540 16395 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:46:08.984735 16423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:08.985819 16395 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:46:08.985932 16395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae"
format_stamp: "Formatted at 2026-08-10 01:46:08 on dist-test-slave-jlzn"
server_key: "7a715246b172872a6515a050575608b9"
server_key_iv: "97bcc3364e11b3ad45900f834d0a480d"
server_key_version: "encryptionkey@0"
I20260810 01:46:08.986021 16395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:08.990283 16395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:08.992852 16395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:08.993005 16395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:08.999207 16395 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46241
I20260810 01:46:08.999249 16506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46241 every 8 connection(s)
I20260810 01:46:09.000061 16395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:09.002562 16507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:09.004647 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 16395
I20260810 01:46:09.004770 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:09.005009 16617 external_mini_cluster.cc:1428] Setting key 505b786c9b58ad004f3f8a7a7d7c2293
I20260810 01:46:09.008076 16507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae: Bootstrap starting.
I20260810 01:46:09.009644 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:09.006184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:38539 (local address 127.0.0.1:46241)
0810 01:46:09.006548 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:09.006562 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:09.006597 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:46:09.007203 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:09.007217 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:09.007465 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:09.007729 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:09.008530 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:09.008535 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:09.008546 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:09.008557 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:09.008606 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:09.008631 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:09.008728 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:09.008833 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 01:46:09.008972 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":103,"threads_started":1}
I20260810 01:46:09.010443 16507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:09.011170 16507 log.cc:824] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:09.012260 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:09.013043 16507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae: No bootstrap required, opened a new log
I20260810 01:46:09.015550 16517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:09.014177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:50475 (local address 127.0.0.1:46241)
0810 01:46:09.014280 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:09.014284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:09.014412 (+ 128us) server_negotiation.cc:407] Connection header received
0810 01:46:09.014536 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:09.014539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:09.014566 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:09.014618 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:09.015226 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:09.015229 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:09.015230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:09.015240 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:09.015263 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:09.015272 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:09.015329 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:09.015417 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 01:46:09.015447 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:46:09.017046 16507 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46241 } }
I20260810 01:46:09.017251 16507 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:09.017309 16507 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad0e7bb9bd4b4329bb071e3c9265a6ae, State: Initialized, Role: FOLLOWER
I20260810 01:46:09.017688 16507 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46241 } }
I20260810 01:46:09.017814 16507 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:09.017903 16507 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:09.017997 16507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:09.018831 16507 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46241 } }
I20260810 01:46:09.019112 16507 leader_election.cc:302] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad0e7bb9bd4b4329bb071e3c9265a6ae; no voters:
I20260810 01:46:09.019341 16507 leader_election.cc:288] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:09.019459 16526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:09.019667 16526 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [term 1 LEADER]: Becoming Leader. State: Replica: ad0e7bb9bd4b4329bb071e3c9265a6ae, State: Running, Role: LEADER
I20260810 01:46:09.019968 16526 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46241 } }
I20260810 01:46:09.020434 16507 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:09.021525 16527 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46241 } } }
I20260810 01:46:09.021528 16528 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad0e7bb9bd4b4329bb071e3c9265a6ae. Latest consensus state: current_term: 1 leader_uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e7bb9bd4b4329bb071e3c9265a6ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46241 } } }
I20260810 01:46:09.021677 16528 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:09.021677 16527 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:09.022069 16540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:09.025157 16540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:09.030763 16540 catalog_manager.cc:1347] Generated new cluster ID: c36e50e6f06a46819ab77ab4b5609a9c
I20260810 01:46:09.030836 16540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:09.049922 16540 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:09.050213 16540 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:09.060607 16540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad0e7bb9bd4b4329bb071e3c9265a6ae: Generated new TSK 0
I20260810 01:46:09.061381 16540 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:09.064169 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 16395
2026-08-10T01:46:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1460 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:09 dist-test-slave-jlzn krb5kdc[16563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:09 dist-test-slave-jlzn krb5kdc[16563](info): set up 2 sockets
Aug 10 01:46:09 dist-test-slave-jlzn krb5kdc[16563](info): commencing operation
krb5kdc: starting...
W20260810 01:46:10.185385 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:10 dist-test-slave-jlzn krb5kdc[16563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:46:10.300691 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43483
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:10.408303 16587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:10.408540 16587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:10.408597 16587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:10.412492 16587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:10.412547 16587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:10.412572 16587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:10.412593 16587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:10.412618 16587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:10.417654 16587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43483
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:10.418601 16587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:10.419567 16587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:10.427718 16599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:10.427714 16596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:10.427714 16597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:10.427954 16587 server_base.cc:1034] running on GCE node
I20260810 01:46:10.428597 16587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:10.429639 16587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:10.430840 16587 hybrid_clock.cc:648] HybridClock initialized: now 1786326370430821 us; error 30 us; skew 500 ppm
Aug 10 01:46:10 dist-test-slave-jlzn krb5kdc[16563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326370, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:10.433526 16587 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:10.434376 16587 webserver.cc:460] Webserver started at http://127.0.0.1:40413/ using document root <none> and password file <none>
I20260810 01:46:10.434893 16587 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:10.434960 16587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:10.435166 16587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:10.437191 16587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "46564091b0904fb4bee62a590e0fe105"
format_stamp: "Formatted at 2026-08-10 01:46:10 on dist-test-slave-jlzn"
server_key: "9be343b2ac46eaf6e5bf6e074e1875f6"
server_key_iv: "e0514d2ec8163091e5dd7ebdeedebc9a"
server_key_version: "encryptionkey@0"
I20260810 01:46:10.437727 16587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "46564091b0904fb4bee62a590e0fe105"
format_stamp: "Formatted at 2026-08-10 01:46:10 on dist-test-slave-jlzn"
server_key: "9be343b2ac46eaf6e5bf6e074e1875f6"
server_key_iv: "e0514d2ec8163091e5dd7ebdeedebc9a"
server_key_version: "encryptionkey@0"
I20260810 01:46:10.441208 16587 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:46:10.443374 16608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:10.444532 16587 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:46:10.444648 16587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "46564091b0904fb4bee62a590e0fe105"
format_stamp: "Formatted at 2026-08-10 01:46:10 on dist-test-slave-jlzn"
server_key: "9be343b2ac46eaf6e5bf6e074e1875f6"
server_key_iv: "e0514d2ec8163091e5dd7ebdeedebc9a"
server_key_version: "encryptionkey@0"
I20260810 01:46:10.444736 16587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:10.469380 16587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:10.474647 16587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:10.474855 16587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:10.487833 16587 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43483
I20260810 01:46:10.487877 16693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43483 every 8 connection(s)
I20260810 01:46:10.489073 16587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:10.492246 16695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:10.495950 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 16587
I20260810 01:46:10.496093 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:10.496382 16617 external_mini_cluster.cc:1428] Setting key b1c96998866cc0dccf95442d64325fdc
I20260810 01:46:10.498799 16695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105: Bootstrap starting.
I20260810 01:46:10.501430 16695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:10.502285 16695 log.cc:824] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:10.504432 16695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105: No bootstrap required, opened a new log
Aug 10 01:46:10 dist-test-slave-jlzn krb5kdc[16563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 01:46:10.508451 16695 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46564091b0904fb4bee62a590e0fe105" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43483 } }
I20260810 01:46:10.508656 16695 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:10.508760 16695 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46564091b0904fb4bee62a590e0fe105, State: Initialized, Role: FOLLOWER
I20260810 01:46:10.509266 16695 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46564091b0904fb4bee62a590e0fe105" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43483 } }
I20260810 01:46:10.509431 16695 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:10.509500 16695 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:10.509600 16695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:10.510545 16695 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46564091b0904fb4bee62a590e0fe105" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43483 } }
I20260810 01:46:10.510891 16695 leader_election.cc:302] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46564091b0904fb4bee62a590e0fe105; no voters:
I20260810 01:46:10.511215 16695 leader_election.cc:288] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:10.511304 16702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:10.511595 16702 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [term 1 LEADER]: Becoming Leader. State: Replica: 46564091b0904fb4bee62a590e0fe105, State: Running, Role: LEADER
I20260810 01:46:10.511997 16702 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46564091b0904fb4bee62a590e0fe105" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43483 } }
I20260810 01:46:10.512547 16695 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:10.513335 16700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:10.498327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:46495 (local address 127.0.0.1:43483)
0810 01:46:10.498798 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:10.498817 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:10.498859 (+ 42us) server_negotiation.cc:407] Connection header received
0810 01:46:10.499645 (+ 786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:10.499668 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:10.500114 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:10.500457 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:10.501364 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:10.502861 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:10.504101 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:10.504790 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:10.504982 (+ 192us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:10.507836 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:10.507844 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:10.507860 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:10.507887 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:10.509718 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:10.510196 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:10.510203 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:10.510209 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:10.510355 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:10.510657 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:10.510660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:10.510662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:10.511181 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:10.511403 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:10.512190 (+ 787us) server_negotiation.cc:299] Negotiation successful
0810 01:46:10.512408 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":146,"threads_started":1}
I20260810 01:46:10.513644 16703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46564091b0904fb4bee62a590e0fe105" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46564091b0904fb4bee62a590e0fe105" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43483 } } }
I20260810 01:46:10.513763 16703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:10.514181 16705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46564091b0904fb4bee62a590e0fe105. Latest consensus state: current_term: 1 leader_uuid: "46564091b0904fb4bee62a590e0fe105" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46564091b0904fb4bee62a590e0fe105" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43483 } } }
I20260810 01:46:10.514318 16705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:10.515211 16715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:10.516499 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:10.518038 16715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:10.523990 16715 catalog_manager.cc:1347] Generated new cluster ID: a8eeb924cb654637a414698f08ff826e
I20260810 01:46:10.524045 16715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:10.527400 16700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:10.518717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:55907 (local address 127.0.0.1:43483)
0810 01:46:10.518825 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:10.518829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:10.519116 (+ 287us) server_negotiation.cc:407] Connection header received
0810 01:46:10.519224 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:10.519227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:10.519274 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:10.519353 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:10.520181 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:10.520948 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:10.521939 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:10.522315 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:10.522422 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:10.524065 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:10.524069 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:10.524071 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:10.524097 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:10.525696 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:10.526197 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:10.526201 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:10.526203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:10.526295 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:10.526576 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:10.526579 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:10.526581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:10.526793 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:10.526938 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:10.527149 (+ 211us) server_negotiation.cc:299] Negotiation successful
0810 01:46:10.527246 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:46:10.537856 16715 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:10.538686 16715 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:10.545288 16715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46564091b0904fb4bee62a590e0fe105: Generated new TSK 0
I20260810 01:46:10.545928 16715 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:10.551935 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 16587
W20260810 01:46:10.566777 16558 connection.cc:535] client connection to 127.0.0.1:43483 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43483): Connection reset by peer (error 104)
2026-08-10T01:46:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:10 dist-test-slave-jlzn krb5kdc[16740](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:10 dist-test-slave-jlzn krb5kdc[16740](info): set up 2 sockets
Aug 10 01:46:10 dist-test-slave-jlzn krb5kdc[16740](info): commencing operation
krb5kdc: starting...
W20260810 01:46:11.688956 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:11 dist-test-slave-jlzn krb5kdc[16740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:46:11.807844 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37273
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37273
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:11.916064 16764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:11.916329 16764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:11.916388 16764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:11.920320 16764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:11.920377 16764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:11.920403 16764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:11.920423 16764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:11.920459 16764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:11.925726 16764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37273
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:11.926715 16764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:11.927690 16764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:11.935758 16773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:11.935846 16764 server_base.cc:1034] running on GCE node
W20260810 01:46:11.935791 16774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:11.935756 16776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:11.936563 16764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:11.937609 16764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:11.938763 16764 hybrid_clock.cc:648] HybridClock initialized: now 1786326371938739 us; error 38 us; skew 500 ppm
Aug 10 01:46:11 dist-test-slave-jlzn krb5kdc[16740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326371, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:11.941361 16764 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:11.942173 16764 webserver.cc:460] Webserver started at http://127.0.0.1:35715/ using document root <none> and password file <none>
I20260810 01:46:11.942685 16764 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:11.942751 16764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:11.942948 16764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:11.945034 16764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "d67ce6dd9cbb47da94d0564c3512bf19"
format_stamp: "Formatted at 2026-08-10 01:46:11 on dist-test-slave-jlzn"
server_key: "3cdbeaa1d35433446aeb823811871ff0"
server_key_iv: "9548069a1773aed21c32c9f94eb0a03d"
server_key_version: "encryptionkey@0"
I20260810 01:46:11.945583 16764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "d67ce6dd9cbb47da94d0564c3512bf19"
format_stamp: "Formatted at 2026-08-10 01:46:11 on dist-test-slave-jlzn"
server_key: "3cdbeaa1d35433446aeb823811871ff0"
server_key_iv: "9548069a1773aed21c32c9f94eb0a03d"
server_key_version: "encryptionkey@0"
I20260810 01:46:11.949091 16764 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:46:11.951277 16786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:11.952474 16764 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:46:11.952589 16764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "d67ce6dd9cbb47da94d0564c3512bf19"
format_stamp: "Formatted at 2026-08-10 01:46:11 on dist-test-slave-jlzn"
server_key: "3cdbeaa1d35433446aeb823811871ff0"
server_key_iv: "9548069a1773aed21c32c9f94eb0a03d"
server_key_version: "encryptionkey@0"
I20260810 01:46:11.952677 16764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:11.965332 16764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:11.967993 16764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:11.968159 16764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:11.974632 16764 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37273
I20260810 01:46:11.974670 16871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37273 every 8 connection(s)
I20260810 01:46:11.975540 16764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:11.978220 16872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:11.982905 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 16764
I20260810 01:46:11.983027 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:11.983268 16617 external_mini_cluster.cc:1428] Setting key 16f1c08bf97e196e40c1a8123bad35da
I20260810 01:46:11.983775 16872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19: Bootstrap starting.
I20260810 01:46:11.986354 16872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:11.987242 16872 log.cc:824] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:11.989243 16872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19: No bootstrap required, opened a new log
I20260810 01:46:11.992448 16876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:11.984622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:37419 (local address 127.0.0.1:37273)
0810 01:46:11.985027 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:11.985046 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:11.985087 (+ 41us) server_negotiation.cc:407] Connection header received
0810 01:46:11.985898 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:11.985920 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:11.986349 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:11.986712 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:11.987116 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:11.988506 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:11.989394 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:11.989854 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:11.990003 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:11.990853 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:11.990858 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:11.990869 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:11.991231 (+ 362us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:11.991284 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:11.991306 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:11.991419 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:11.991609 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 01:46:11.991735 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":98,"threads_started":1}
I20260810 01:46:11.992839 16872 raft_consensus.cc:348] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67ce6dd9cbb47da94d0564c3512bf19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37273 } }
I20260810 01:46:11.993050 16872 raft_consensus.cc:374] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:11.993108 16872 raft_consensus.cc:729] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d67ce6dd9cbb47da94d0564c3512bf19, State: Initialized, Role: FOLLOWER
I20260810 01:46:11.993474 16872 consensus_queue.cc:260] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67ce6dd9cbb47da94d0564c3512bf19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37273 } }
I20260810 01:46:11.993602 16872 raft_consensus.cc:388] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:11.993674 16872 raft_consensus.cc:482] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:11.993773 16872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:11.994695 16872 raft_consensus.cc:504] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67ce6dd9cbb47da94d0564c3512bf19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37273 } }
I20260810 01:46:11.995018 16872 leader_election.cc:302] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d67ce6dd9cbb47da94d0564c3512bf19; no voters:
I20260810 01:46:11.995106 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:11.995337 16872 leader_election.cc:288] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:11.995409 16879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:11.995606 16879 raft_consensus.cc:686] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [term 1 LEADER]: Becoming Leader. State: Replica: d67ce6dd9cbb47da94d0564c3512bf19, State: Running, Role: LEADER
I20260810 01:46:11.995930 16879 consensus_queue.cc:237] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67ce6dd9cbb47da94d0564c3512bf19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37273 } }
I20260810 01:46:11.996577 16872 sys_catalog.cc:564] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:11.997046 16879 sys_catalog.cc:455] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d67ce6dd9cbb47da94d0564c3512bf19. Latest consensus state: current_term: 1 leader_uuid: "d67ce6dd9cbb47da94d0564c3512bf19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67ce6dd9cbb47da94d0564c3512bf19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37273 } } }
I20260810 01:46:11.997166 16879 sys_catalog.cc:458] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:11.997812 16880 sys_catalog.cc:455] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d67ce6dd9cbb47da94d0564c3512bf19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d67ce6dd9cbb47da94d0564c3512bf19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37273 } } }
I20260810 01:46:11.997921 16880 sys_catalog.cc:458] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:11.998778 16892 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:12.001348 16892 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:12.001873 16876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:11.997201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:32869 (local address 127.0.0.1:37273)
0810 01:46:11.997298 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:11.997301 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:11.997508 (+ 207us) server_negotiation.cc:407] Connection header received
0810 01:46:11.997706 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:11.997709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:11.997755 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:11.997802 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:11.998225 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:11.998929 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:11.999984 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:12.000298 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:12.000368 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:12.001370 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:12.001374 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:12.001377 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:12.001390 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:12.001416 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:12.001428 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:12.001482 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:12.001718 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 01:46:12.001752 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 01:46:12.006242 16892 catalog_manager.cc:1347] Generated new cluster ID: 49458df35810433db1ec397b0e56e934
I20260810 01:46:12.006291 16892 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:12.018474 16892 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:12.019361 16892 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:12.026752 16892 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d67ce6dd9cbb47da94d0564c3512bf19: Generated new TSK 0
I20260810 01:46:12.027384 16892 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:12.033492 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 16764
W20260810 01:46:12.043912 16737 connection.cc:535] client connection to 127.0.0.1:37273 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37273): Connection reset by peer (error 104)
2026-08-10T01:46:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1477 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:12 dist-test-slave-jlzn krb5kdc[16923](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:12 dist-test-slave-jlzn krb5kdc[16923](info): set up 2 sockets
Aug 10 01:46:12 dist-test-slave-jlzn krb5kdc[16923](info): commencing operation
krb5kdc: starting...
W20260810 01:46:13.157953 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:13 dist-test-slave-jlzn krb5kdc[16923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 01:46:13.276087 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:13.384941 16950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:13.385205 16950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:13.385245 16950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:13.389056 16950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:13.389101 16950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:13.389118 16950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:13.389145 16950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:13.389159 16950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:13.394155 16950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39469
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:13.395013 16950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:13.395921 16950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:13.403774 16957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:13.403942 16961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:13.403846 16958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:13.404595 16950 server_base.cc:1034] running on GCE node
I20260810 01:46:13.405090 16950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:13.406069 16950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:13.407222 16950 hybrid_clock.cc:648] HybridClock initialized: now 1786326373407197 us; error 38 us; skew 500 ppm
Aug 10 01:46:13 dist-test-slave-jlzn krb5kdc[16923](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326373, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:13.409750 16950 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 01:46:13.410529 16950 webserver.cc:460] Webserver started at http://127.0.0.1:42981/ using document root <none> and password file <none>
I20260810 01:46:13.411036 16950 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:13.411095 16950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:13.411289 16950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:13.413240 16950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "96d41511d8494aee8b5bc4c02e553c39"
format_stamp: "Formatted at 2026-08-10 01:46:13 on dist-test-slave-jlzn"
server_key: "0bb990a5f36f2ca8e75ac7651f7a51a7"
server_key_iv: "eae152c4c6ab3609553572c4ef5235f3"
server_key_version: "encryptionkey@0"
I20260810 01:46:13.413772 16950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "96d41511d8494aee8b5bc4c02e553c39"
format_stamp: "Formatted at 2026-08-10 01:46:13 on dist-test-slave-jlzn"
server_key: "0bb990a5f36f2ca8e75ac7651f7a51a7"
server_key_iv: "eae152c4c6ab3609553572c4ef5235f3"
server_key_version: "encryptionkey@0"
I20260810 01:46:13.417230 16950 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260810 01:46:13.419391 16973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:13.420550 16950 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:46:13.420673 16950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "96d41511d8494aee8b5bc4c02e553c39"
format_stamp: "Formatted at 2026-08-10 01:46:13 on dist-test-slave-jlzn"
server_key: "0bb990a5f36f2ca8e75ac7651f7a51a7"
server_key_iv: "eae152c4c6ab3609553572c4ef5235f3"
server_key_version: "encryptionkey@0"
I20260810 01:46:13.420768 16950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:13.425060 16950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:13.427680 16950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:13.427867 16950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:13.434470 16950 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39469
I20260810 01:46:13.434486 17065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39469 every 8 connection(s)
I20260810 01:46:13.435329 16950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:13.437951 17069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:13.441340 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 16950
I20260810 01:46:13.441476 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:13.441766 16617 external_mini_cluster.cc:1428] Setting key 2193ba8fd9450682cd70ed4f35507b8d
I20260810 01:46:13.443825 17069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39: Bootstrap starting.
I20260810 01:46:13.446044 17069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:13.446792 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:13.443162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:33991 (local address 127.0.0.1:39469)
0810 01:46:13.443597 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:13.443635 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:13.443671 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:46:13.444354 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:13.444372 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:13.444640 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:13.444932 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:13.445655 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:13.445660 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:13.445671 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:13.445681 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:13.445734 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:13.445753 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:13.445846 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:13.445965 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 01:46:13.446120 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":123,"threads_started":1}
I20260810 01:46:13.446781 17069 log.cc:824] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:13.448865 17069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39: No bootstrap required, opened a new log
I20260810 01:46:13.449437 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:13.452812 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:13.451285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.68:50273 (local address 127.0.0.1:39469)
0810 01:46:13.451383 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:13.451387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:13.451575 (+ 188us) server_negotiation.cc:407] Connection header received
0810 01:46:13.451676 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:13.451679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:13.451711 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:13.451771 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:13.452443 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:13.452446 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:13.452449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:13.452460 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:13.452486 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:13.452496 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:13.452564 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:13.452646 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 01:46:13.452684 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 01:46:13.452678 17069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d41511d8494aee8b5bc4c02e553c39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39469 } }
I20260810 01:46:13.452996 17069 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:13.453068 17069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96d41511d8494aee8b5bc4c02e553c39, State: Initialized, Role: FOLLOWER
I20260810 01:46:13.453464 17069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d41511d8494aee8b5bc4c02e553c39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39469 } }
I20260810 01:46:13.453594 17069 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:13.453671 17069 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:13.453778 17069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:13.454613 17069 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d41511d8494aee8b5bc4c02e553c39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39469 } }
I20260810 01:46:13.454928 17069 leader_election.cc:302] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96d41511d8494aee8b5bc4c02e553c39; no voters:
I20260810 01:46:13.455199 17069 leader_election.cc:288] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:13.455279 17092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:13.455456 17092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [term 1 LEADER]: Becoming Leader. State: Replica: 96d41511d8494aee8b5bc4c02e553c39, State: Running, Role: LEADER
I20260810 01:46:13.455747 17092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d41511d8494aee8b5bc4c02e553c39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39469 } }
I20260810 01:46:13.456478 17069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:13.457521 17093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96d41511d8494aee8b5bc4c02e553c39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d41511d8494aee8b5bc4c02e553c39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39469 } } }
I20260810 01:46:13.457530 17095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96d41511d8494aee8b5bc4c02e553c39. Latest consensus state: current_term: 1 leader_uuid: "96d41511d8494aee8b5bc4c02e553c39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96d41511d8494aee8b5bc4c02e553c39" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39469 } } }
I20260810 01:46:13.457721 17095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:13.457732 17093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:13.458148 17106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:13.461288 17106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:13.466712 17106 catalog_manager.cc:1347] Generated new cluster ID: 5405785a0ee74c8b9eb76497548169cf
I20260810 01:46:13.466773 17106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:13.477264 17106 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:13.477571 17106 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:13.488423 17106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96d41511d8494aee8b5bc4c02e553c39: Generated new TSK 0
I20260810 01:46:13.489153 17106 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:13.494696 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 16950
2026-08-10T01:46:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1466 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:13 dist-test-slave-jlzn krb5kdc[17126](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:13 dist-test-slave-jlzn krb5kdc[17126](info): set up 2 sockets
Aug 10 01:46:13 dist-test-slave-jlzn krb5kdc[17126](info): commencing operation
krb5kdc: starting...
W20260810 01:46:14.622546 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:14 dist-test-slave-jlzn krb5kdc[17126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:46:14.735975 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:37529
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:41359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:37529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:14.843704 17147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:14.843977 17147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:14.844017 17147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:14.847836 17147 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:14.847882 17147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:14.847899 17147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:14.847914 17147 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:14.847931 17147 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:14.852916 17147 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:41359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:37529
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:37529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:14.853819 17147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:14.854740 17147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:14.862839 17157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:14.862828 17153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:14.862825 17154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:14.863144 17147 server_base.cc:1034] running on GCE node
I20260810 01:46:14.863709 17147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:14.864989 17147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:14.866130 17147 hybrid_clock.cc:648] HybridClock initialized: now 1786326374866104 us; error 40 us; skew 500 ppm
Aug 10 01:46:14 dist-test-slave-jlzn krb5kdc[17126](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326374, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:14.872189 17147 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:46:14.873083 17147 webserver.cc:460] Webserver started at http://127.16.58.126:35417/ using document root <none> and password file <none>
I20260810 01:46:14.873589 17147 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:14.873658 17147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:14.873827 17147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:14.875833 17147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "8a651970de794aeabbba41376f674ab0"
format_stamp: "Formatted at 2026-08-10 01:46:14 on dist-test-slave-jlzn"
server_key: "22bfa43b9871c7ccdc1a338df980864f"
server_key_iv: "e485ba76d9fa68b7d278eef2c2140b62"
server_key_version: "encryptionkey@0"
I20260810 01:46:14.876379 17147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "8a651970de794aeabbba41376f674ab0"
format_stamp: "Formatted at 2026-08-10 01:46:14 on dist-test-slave-jlzn"
server_key: "22bfa43b9871c7ccdc1a338df980864f"
server_key_iv: "e485ba76d9fa68b7d278eef2c2140b62"
server_key_version: "encryptionkey@0"
I20260810 01:46:14.879951 17147 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20260810 01:46:14.882190 17173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:14.883324 17147 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:46:14.883428 17147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "8a651970de794aeabbba41376f674ab0"
format_stamp: "Formatted at 2026-08-10 01:46:14 on dist-test-slave-jlzn"
server_key: "22bfa43b9871c7ccdc1a338df980864f"
server_key_iv: "e485ba76d9fa68b7d278eef2c2140b62"
server_key_version: "encryptionkey@0"
I20260810 01:46:14.883507 17147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:14.894418 17147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:14.896893 17147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:14.897028 17147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:14.903451 17147 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:37529
I20260810 01:46:14.903471 17265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:37529 every 8 connection(s)
I20260810 01:46:14.904299 17147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:14.906806 17269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:14.910965 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17147
I20260810 01:46:14.911099 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:14.911365 16617 external_mini_cluster.cc:1428] Setting key 08958e11b25bede6f63019a7d3aaac65
I20260810 01:46:14.912400 17269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0: Bootstrap starting.
I20260810 01:46:14.914604 17269 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:14.915427 17269 log.cc:824] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:14.917403 17269 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0: No bootstrap required, opened a new log
Aug 10 01:46:14 dist-test-slave-jlzn krb5kdc[17126](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:46:14.921350 17269 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a651970de794aeabbba41376f674ab0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37529 } }
I20260810 01:46:14.921587 17269 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:14.921653 17269 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a651970de794aeabbba41376f674ab0, State: Initialized, Role: FOLLOWER
I20260810 01:46:14.922143 17269 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a651970de794aeabbba41376f674ab0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37529 } }
I20260810 01:46:14.922300 17269 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:14.922369 17269 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:14.922466 17269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:14.923393 17269 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a651970de794aeabbba41376f674ab0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37529 } }
I20260810 01:46:14.923700 17269 leader_election.cc:302] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a651970de794aeabbba41376f674ab0; no voters:
I20260810 01:46:14.924011 17269 leader_election.cc:288] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:14.924083 17277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:14.924290 17277 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [term 1 LEADER]: Becoming Leader. State: Replica: 8a651970de794aeabbba41376f674ab0, State: Running, Role: LEADER
I20260810 01:46:14.924623 17277 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a651970de794aeabbba41376f674ab0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37529 } }
I20260810 01:46:14.925326 17269 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:14.925773 17280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a651970de794aeabbba41376f674ab0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a651970de794aeabbba41376f674ab0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37529 } } }
I20260810 01:46:14.925743 17278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a651970de794aeabbba41376f674ab0. Latest consensus state: current_term: 1 leader_uuid: "8a651970de794aeabbba41376f674ab0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a651970de794aeabbba41376f674ab0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 37529 } } }
I20260810 01:46:14.925922 17278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:14.925884 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:14.912704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43649 (local address 127.16.58.126:37529)
0810 01:46:14.913069 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:14.913083 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:14.913117 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:46:14.913734 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:14.913751 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:14.914052 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:14.914306 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:14.915172 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:14.916356 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:14.917490 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:14.917962 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:14.918073 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:14.920715 (+ 2642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:14.920720 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:14.920732 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:14.920758 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:14.922646 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:14.923121 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:14.923127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:14.923132 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:14.923281 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:14.923601 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:14.923604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:14.923606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:14.924063 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:14.924282 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:14.924677 (+ 395us) server_negotiation.cc:299] Negotiation successful
0810 01:46:14.924966 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":98,"threads_started":1}
I20260810 01:46:14.925873 17280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:14.929271 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 01:46:14.929832 17301 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:14.929898 17301 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:14.929948 17289 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:14.930624 17289 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:14.936057 17289 catalog_manager.cc:1347] Generated new cluster ID: 5257b92a23164179be696831592f9963
I20260810 01:46:14.936123 17289 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:14.939839 17275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:14.931419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54505 (local address 127.16.58.126:37529)
0810 01:46:14.931543 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:14.931547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:14.932166 (+ 619us) server_negotiation.cc:407] Connection header received
0810 01:46:14.932291 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:14.932295 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:14.932338 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:14.932410 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:14.933191 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:14.933895 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:14.934798 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:14.935039 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:14.935122 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:14.936558 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:14.936562 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:14.936565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:14.936590 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:14.938124 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:14.938606 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:14.938609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:14.938611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:14.938699 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:14.938983 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:14.938986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:14.938988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:14.939191 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:14.939334 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:14.939553 (+ 219us) server_negotiation.cc:299] Negotiation successful
0810 01:46:14.939648 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 01:46:14.951081 17289 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:14.951957 17289 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:14.962203 17289 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8a651970de794aeabbba41376f674ab0: Generated new TSK 0
I20260810 01:46:14.962834 17289 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:14.966877 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17147
W20260810 01:46:14.981683 17124 connection.cc:535] client connection to 127.16.58.126:37529 recv error: Network error: failed to read from TLS socket (remote: 127.16.58.126:37529): Connection reset by peer (error 104)
2026-08-10T01:46:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1471 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:15 dist-test-slave-jlzn krb5kdc[17315](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:15 dist-test-slave-jlzn krb5kdc[17315](info): set up 2 sockets
Aug 10 01:46:15 dist-test-slave-jlzn krb5kdc[17315](info): commencing operation
krb5kdc: starting...
W20260810 01:46:16.099063 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:16 dist-test-slave-jlzn krb5kdc[17315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:46:16.214344 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:44001
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:44001
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:16.322037 17330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:16.322283 17330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:16.322322 17330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:16.326167 17330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:16.326222 17330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:16.326239 17330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:16.326254 17330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:16.326273 17330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:16.331298 17330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:44001
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:44001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:16.332253 17330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:16.333151 17330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:16.341275 17335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:16.341295 17342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:16.341281 17330 server_base.cc:1034] running on GCE node
W20260810 01:46:16.341300 17337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:16.341964 17330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:16.342943 17330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:16.344094 17330 hybrid_clock.cc:648] HybridClock initialized: now 1786326376344081 us; error 27 us; skew 500 ppm
Aug 10 01:46:16 dist-test-slave-jlzn krb5kdc[17315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326376, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:16.346686 17330 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:46:16.347541 17330 webserver.cc:460] Webserver started at http://127.16.58.126:34613/ using document root <none> and password file <none>
I20260810 01:46:16.348100 17330 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:16.348172 17330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:16.348366 17330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:16.350333 17330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "70ecb8e0ead04d1f897989b69ff75b99"
format_stamp: "Formatted at 2026-08-10 01:46:16 on dist-test-slave-jlzn"
server_key: "450851e87194fc7a49d68ffeaa414a4e"
server_key_iv: "9ea12f87993d6fe13f7f3418caa2ec9c"
server_key_version: "encryptionkey@0"
I20260810 01:46:16.350864 17330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "70ecb8e0ead04d1f897989b69ff75b99"
format_stamp: "Formatted at 2026-08-10 01:46:16 on dist-test-slave-jlzn"
server_key: "450851e87194fc7a49d68ffeaa414a4e"
server_key_iv: "9ea12f87993d6fe13f7f3418caa2ec9c"
server_key_version: "encryptionkey@0"
I20260810 01:46:16.354331 17330 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260810 01:46:16.356527 17351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:16.357645 17330 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260810 01:46:16.357769 17330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "70ecb8e0ead04d1f897989b69ff75b99"
format_stamp: "Formatted at 2026-08-10 01:46:16 on dist-test-slave-jlzn"
server_key: "450851e87194fc7a49d68ffeaa414a4e"
server_key_iv: "9ea12f87993d6fe13f7f3418caa2ec9c"
server_key_version: "encryptionkey@0"
I20260810 01:46:16.357854 17330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:16.382735 17330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:16.385226 17330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:16.385391 17330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:16.391942 17330 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:44001
I20260810 01:46:16.391986 17447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:44001 every 8 connection(s)
I20260810 01:46:16.392809 17330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:16.395363 17448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:16.399621 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17330
I20260810 01:46:16.399732 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:16.399981 16617 external_mini_cluster.cc:1428] Setting key 6f227bc25bbed65063fca5d4806b6064
I20260810 01:46:16.400717 17448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99: Bootstrap starting.
I20260810 01:46:16.403208 17448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:16.404062 17448 log.cc:824] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:16.405929 17448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99: No bootstrap required, opened a new log
I20260810 01:46:16.409279 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:16.401256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47271 (local address 127.16.58.126:44001)
0810 01:46:16.401660 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:16.401679 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:16.401726 (+ 47us) server_negotiation.cc:407] Connection header received
0810 01:46:16.402517 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:16.402540 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:16.402934 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:16.403275 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:16.403695 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:16.404985 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:16.405852 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:16.406517 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:16.406680 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:16.407388 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:16.407396 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:16.407412 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:16.407904 (+ 492us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:16.407968 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:16.407996 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:16.408122 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:16.408250 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 01:46:16.408374 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":105,"threads_started":1}
I20260810 01:46:16.410043 17448 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ecb8e0ead04d1f897989b69ff75b99" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44001 } }
I20260810 01:46:16.410269 17448 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:16.410332 17448 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70ecb8e0ead04d1f897989b69ff75b99, State: Initialized, Role: FOLLOWER
I20260810 01:46:16.410725 17448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ecb8e0ead04d1f897989b69ff75b99" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44001 } }
I20260810 01:46:16.410842 17448 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:16.410943 17448 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:16.411072 17448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:16.412007 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:16.412076 17448 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ecb8e0ead04d1f897989b69ff75b99" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44001 } }
I20260810 01:46:16.412390 17448 leader_election.cc:302] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70ecb8e0ead04d1f897989b69ff75b99; no voters:
I20260810 01:46:16.412667 17448 leader_election.cc:288] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:16.412761 17453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:16.412961 17453 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [term 1 LEADER]: Becoming Leader. State: Replica: 70ecb8e0ead04d1f897989b69ff75b99, State: Running, Role: LEADER
I20260810 01:46:16.413275 17453 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ecb8e0ead04d1f897989b69ff75b99" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44001 } }
I20260810 01:46:16.413782 17448 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:16.414460 17457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70ecb8e0ead04d1f897989b69ff75b99. Latest consensus state: current_term: 1 leader_uuid: "70ecb8e0ead04d1f897989b69ff75b99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ecb8e0ead04d1f897989b69ff75b99" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44001 } } }
I20260810 01:46:16.414604 17457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:16.414935 17474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:16.414925 17455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70ecb8e0ead04d1f897989b69ff75b99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70ecb8e0ead04d1f897989b69ff75b99" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 44001 } } }
I20260810 01:46:16.415078 17455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:16.418221 17474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:16.419500 17451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:16.414155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40935 (local address 127.16.58.126:44001)
0810 01:46:16.414249 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:16.414252 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:16.415011 (+ 759us) server_negotiation.cc:407] Connection header received
0810 01:46:16.415218 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:16.415220 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:16.415255 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:16.415317 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:16.415719 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:16.416491 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:16.417543 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:16.417855 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:16.417928 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:16.418932 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:16.418936 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:16.418938 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:16.418952 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:16.418982 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:16.418996 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:16.419059 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:16.419331 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 01:46:16.419368 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":37}
I20260810 01:46:16.428081 17474 catalog_manager.cc:1347] Generated new cluster ID: 263928605c9240bcaa6f101418c8620d
I20260810 01:46:16.428145 17474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:16.435108 17474 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:16.436272 17474 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:16.441908 17474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70ecb8e0ead04d1f897989b69ff75b99: Generated new TSK 0
I20260810 01:46:16.442468 17474 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:16.446674 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17330
W20260810 01:46:16.455540 17312 connection.cc:535] client connection to 127.16.58.126:44001 recv error: Network error: failed to read from TLS socket (remote: 127.16.58.126:44001): Connection reset by peer (error 104)
2026-08-10T01:46:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1473 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:16 dist-test-slave-jlzn krb5kdc[17491](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:16 dist-test-slave-jlzn krb5kdc[17491](info): set up 2 sockets
Aug 10 01:46:16 dist-test-slave-jlzn krb5kdc[17491](info): commencing operation
krb5kdc: starting...
W20260810 01:46:17.563512 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:17 dist-test-slave-jlzn krb5kdc[17491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326377, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:46:17.677757 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:45697
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:34015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:45697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:17.784794 17510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:17.785029 17510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:17.785072 17510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:17.788926 17510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:17.788975 17510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:17.789005 17510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:17.789033 17510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:17.789062 17510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:17.794075 17510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:34015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:45697
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:45697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:17.795004 17510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:17.795945 17510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:17.803758 17520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:17.803932 17510 server_base.cc:1034] running on GCE node
W20260810 01:46:17.803753 17525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:17.803750 17519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:17.804582 17510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:17.805553 17510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:17.806722 17510 hybrid_clock.cc:648] HybridClock initialized: now 1786326377806699 us; error 34 us; skew 500 ppm
Aug 10 01:46:17 dist-test-slave-jlzn krb5kdc[17491](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326377, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:17.809357 17510 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:46:17.810204 17510 webserver.cc:460] Webserver started at http://127.16.58.126:33407/ using document root <none> and password file <none>
I20260810 01:46:17.810710 17510 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:17.810774 17510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:17.810968 17510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:17.812988 17510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "cedb24bfb42542f587da69507ecd2b27"
format_stamp: "Formatted at 2026-08-10 01:46:17 on dist-test-slave-jlzn"
server_key: "d1376c1f91f6ac9793e1d11075207439"
server_key_iv: "b4da0026410ac94fed67bfdebcc0b8de"
server_key_version: "encryptionkey@0"
I20260810 01:46:17.813513 17510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "cedb24bfb42542f587da69507ecd2b27"
format_stamp: "Formatted at 2026-08-10 01:46:17 on dist-test-slave-jlzn"
server_key: "d1376c1f91f6ac9793e1d11075207439"
server_key_iv: "b4da0026410ac94fed67bfdebcc0b8de"
server_key_version: "encryptionkey@0"
I20260810 01:46:17.816938 17510 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:46:17.819133 17537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:17.820286 17510 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:46:17.820397 17510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "cedb24bfb42542f587da69507ecd2b27"
format_stamp: "Formatted at 2026-08-10 01:46:17 on dist-test-slave-jlzn"
server_key: "d1376c1f91f6ac9793e1d11075207439"
server_key_iv: "b4da0026410ac94fed67bfdebcc0b8de"
server_key_version: "encryptionkey@0"
I20260810 01:46:17.820482 17510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:17.824798 17510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:17.827672 17510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:17.827894 17510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:17.834522 17510 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:45697
I20260810 01:46:17.834537 17625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:45697 every 8 connection(s)
I20260810 01:46:17.835376 17510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:17.837982 17626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:17.843180 17626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27: Bootstrap starting.
I20260810 01:46:17.843456 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17510
I20260810 01:46:17.843587 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:17.843849 16617 external_mini_cluster.cc:1428] Setting key fb1d4635bbdc86bdb9cbfb3a5f0a5e13
I20260810 01:46:17.845573 17626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:17.846323 17626 log.cc:824] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:17.848292 17626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27: No bootstrap required, opened a new log
I20260810 01:46:17.849272 17630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:17.845033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37997 (local address 127.16.58.126:45697)
0810 01:46:17.845413 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:17.845427 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:17.845462 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:46:17.846107 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:17.846124 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:17.846378 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:17.846670 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:17.848118 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:17.848122 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:17.848133 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:17.848143 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:17.848191 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:17.848210 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:17.848291 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:17.848454 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 01:46:17.848605 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":99,"threads_started":1}
I20260810 01:46:17.851984 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:17.852108 17626 raft_consensus.cc:348] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedb24bfb42542f587da69507ecd2b27" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45697 } }
I20260810 01:46:17.852351 17626 raft_consensus.cc:374] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:17.852401 17626 raft_consensus.cc:729] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cedb24bfb42542f587da69507ecd2b27, State: Initialized, Role: FOLLOWER
I20260810 01:46:17.852852 17626 consensus_queue.cc:260] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedb24bfb42542f587da69507ecd2b27" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45697 } }
I20260810 01:46:17.853024 17626 raft_consensus.cc:388] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:17.853092 17626 raft_consensus.cc:482] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:17.853185 17626 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:17.854223 17626 raft_consensus.cc:504] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedb24bfb42542f587da69507ecd2b27" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45697 } }
I20260810 01:46:17.854607 17626 leader_election.cc:302] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cedb24bfb42542f587da69507ecd2b27; no voters:
I20260810 01:46:17.854954 17626 leader_election.cc:288] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:17.855050 17639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:17.855254 17639 raft_consensus.cc:686] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [term 1 LEADER]: Becoming Leader. State: Replica: cedb24bfb42542f587da69507ecd2b27, State: Running, Role: LEADER
I20260810 01:46:17.855589 17639 consensus_queue.cc:237] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedb24bfb42542f587da69507ecd2b27" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45697 } }
I20260810 01:46:17.855892 17630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:17.854233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47723 (local address 127.16.58.126:45697)
0810 01:46:17.854336 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:17.854340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:17.854492 (+ 152us) server_negotiation.cc:407] Connection header received
0810 01:46:17.854607 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:17.854609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:17.854636 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:17.854694 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:17.855429 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:17.855433 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:17.855436 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:17.855447 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:17.855473 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:17.855487 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:17.855540 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:17.855724 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 01:46:17.855765 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 01:46:17.856177 17626 sys_catalog.cc:564] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:17.856894 17639 sys_catalog.cc:455] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cedb24bfb42542f587da69507ecd2b27. Latest consensus state: current_term: 1 leader_uuid: "cedb24bfb42542f587da69507ecd2b27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedb24bfb42542f587da69507ecd2b27" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45697 } } }
I20260810 01:46:17.857456 17642 sys_catalog.cc:455] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cedb24bfb42542f587da69507ecd2b27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cedb24bfb42542f587da69507ecd2b27" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 45697 } } }
I20260810 01:46:17.857553 17639 sys_catalog.cc:458] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:17.857609 17642 sys_catalog.cc:458] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:17.858289 17657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:17.860805 17657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:17.865803 17657 catalog_manager.cc:1347] Generated new cluster ID: 9e5ea5f9e08f4e2082c8d4fef4093b89
I20260810 01:46:17.865863 17657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:17.877547 17657 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:17.877884 17657 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:17.887704 17657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cedb24bfb42542f587da69507ecd2b27: Generated new TSK 0
I20260810 01:46:17.888320 17657 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:17.890800 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17510
2026-08-10T01:46:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:17 dist-test-slave-jlzn krb5kdc[17671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:17 dist-test-slave-jlzn krb5kdc[17671](info): set up 2 sockets
Aug 10 01:46:17 dist-test-slave-jlzn krb5kdc[17671](info): commencing operation
krb5kdc: starting...
W20260810 01:46:19.031155 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:19 dist-test-slave-jlzn krb5kdc[17671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:46:19.144474 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38619
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:37531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:38619
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:19.252315 17689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:19.252568 17689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:19.252626 17689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:19.256817 17689 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:19.256871 17689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:19.256898 17689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:19.256920 17689 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:19.256949 17689 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:19.261979 17689 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:37531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:38619
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:19.262908 17689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:19.263891 17689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:19.271867 17698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:19.271867 17701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:19.271857 17699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:19.272065 17689 server_base.cc:1034] running on GCE node
I20260810 01:46:19.272660 17689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:19.273648 17689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:19.274809 17689 hybrid_clock.cc:648] HybridClock initialized: now 1786326379274791 us; error 32 us; skew 500 ppm
Aug 10 01:46:19 dist-test-slave-jlzn krb5kdc[17671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326379, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:19.277379 17689 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:46:19.278203 17689 webserver.cc:460] Webserver started at http://127.16.58.126:42349/ using document root <none> and password file <none>
I20260810 01:46:19.278708 17689 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:19.278772 17689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:19.278954 17689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:19.280910 17689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "4c5bf2579fe0474a911c8b19de6de192"
format_stamp: "Formatted at 2026-08-10 01:46:19 on dist-test-slave-jlzn"
server_key: "e523ca0b9475d6ccc064b9542190f8af"
server_key_iv: "766b2aa4baa4726b11639dca3f0f0caa"
server_key_version: "encryptionkey@0"
I20260810 01:46:19.281430 17689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "4c5bf2579fe0474a911c8b19de6de192"
format_stamp: "Formatted at 2026-08-10 01:46:19 on dist-test-slave-jlzn"
server_key: "e523ca0b9475d6ccc064b9542190f8af"
server_key_iv: "766b2aa4baa4726b11639dca3f0f0caa"
server_key_version: "encryptionkey@0"
I20260810 01:46:19.284845 17689 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 01:46:19.287149 17709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:19.288688 17689 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 01:46:19.288810 17689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "4c5bf2579fe0474a911c8b19de6de192"
format_stamp: "Formatted at 2026-08-10 01:46:19 on dist-test-slave-jlzn"
server_key: "e523ca0b9475d6ccc064b9542190f8af"
server_key_iv: "766b2aa4baa4726b11639dca3f0f0caa"
server_key_version: "encryptionkey@0"
I20260810 01:46:19.288913 17689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:19.307518 17689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:19.310107 17689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:19.310278 17689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:19.316998 17689 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:38619
I20260810 01:46:19.317019 17800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:38619 every 8 connection(s)
I20260810 01:46:19.317893 17689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:19.319777 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17689
I20260810 01:46:19.319921 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:19.320188 16617 external_mini_cluster.cc:1428] Setting key cf09e021be5ffce6ea4e937e0bbad285
I20260810 01:46:19.320639 17801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:19.327071 17801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192: Bootstrap starting.
Aug 10 01:46:19 dist-test-slave-jlzn krb5kdc[17671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:46:19.329679 17801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:19.330511 17801 log.cc:824] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:19.332576 17801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192: No bootstrap required, opened a new log
I20260810 01:46:19.333820 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:19.321412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39177 (local address 127.16.58.126:38619)
0810 01:46:19.321810 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:19.321826 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:19.321862 (+ 36us) server_negotiation.cc:407] Connection header received
0810 01:46:19.322521 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:19.322537 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:19.322845 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:19.323119 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:19.324031 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:19.325069 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:19.326237 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:19.326697 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:19.326816 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:19.329551 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:19.329557 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:19.329569 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:19.329596 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:19.331147 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:19.331602 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:19.331607 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:19.331611 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:19.331723 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:19.332039 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:19.332042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:19.332043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:19.332419 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:19.332561 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:19.332868 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 01:46:19.333145 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":120,"threads_started":1}
I20260810 01:46:19.336496 17801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5bf2579fe0474a911c8b19de6de192" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38619 } }
I20260810 01:46:19.336673 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:19.336747 17801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:19.336799 17801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c5bf2579fe0474a911c8b19de6de192, State: Initialized, Role: FOLLOWER
I20260810 01:46:19.337286 17801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5bf2579fe0474a911c8b19de6de192" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38619 } }
I20260810 01:46:19.337440 17801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:19.337512 17801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:19.337608 17801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:19.338661 17801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5bf2579fe0474a911c8b19de6de192" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38619 } }
I20260810 01:46:19.339051 17801 leader_election.cc:302] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c5bf2579fe0474a911c8b19de6de192; no voters:
I20260810 01:46:19.339393 17801 leader_election.cc:288] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:19.339483 17815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:19.339713 17815 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [term 1 LEADER]: Becoming Leader. State: Replica: 4c5bf2579fe0474a911c8b19de6de192, State: Running, Role: LEADER
I20260810 01:46:19.340082 17815 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5bf2579fe0474a911c8b19de6de192" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38619 } }
I20260810 01:46:19.340621 17801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:19.341908 17816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c5bf2579fe0474a911c8b19de6de192" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5bf2579fe0474a911c8b19de6de192" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38619 } } }
I20260810 01:46:19.342042 17816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:19.342382 17817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c5bf2579fe0474a911c8b19de6de192. Latest consensus state: current_term: 1 leader_uuid: "4c5bf2579fe0474a911c8b19de6de192" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5bf2579fe0474a911c8b19de6de192" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38619 } } }
I20260810 01:46:19.342540 17817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192 [sys.catalog]: This master's current role is: LEADER
W20260810 01:46:19.345530 17837 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:19.345599 17837 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:19.345691 17831 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:19.346588 17831 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:19.347347 17806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:19.338866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35395 (local address 127.16.58.126:38619)
0810 01:46:19.338972 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:19.338976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:19.339104 (+ 128us) server_negotiation.cc:407] Connection header received
0810 01:46:19.339260 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:19.339263 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:19.339300 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:19.339363 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:19.340153 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:19.340937 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:19.342063 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:19.342393 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:19.342491 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:19.344128 (+ 1637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:19.344131 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:19.344134 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:19.344158 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:19.345650 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:19.346089 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:19.346092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:19.346094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:19.346182 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:19.346476 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:19.346479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:19.346480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:19.346699 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:19.346827 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:19.347085 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 01:46:19.347200 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:46:19.352183 17831 catalog_manager.cc:1347] Generated new cluster ID: b18579d91d6745ac945dad6e2049c5e7
I20260810 01:46:19.352244 17831 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:19.356901 17831 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:19.357990 17831 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:19.367488 17831 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c5bf2579fe0474a911c8b19de6de192: Generated new TSK 0
I20260810 01:46:19.368225 17831 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:19.372931 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17689
2026-08-10T01:46:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1480 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:19 dist-test-slave-jlzn krb5kdc[17849](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:19 dist-test-slave-jlzn krb5kdc[17849](info): set up 2 sockets
Aug 10 01:46:19 dist-test-slave-jlzn krb5kdc[17849](info): commencing operation
krb5kdc: starting...
W20260810 01:46:20.495448 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:20 dist-test-slave-jlzn krb5kdc[17849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:46:20.627009 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35165
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:39625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:35165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:20.733471 17867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:20.733718 17867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:20.733776 17867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:20.737682 17867 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:20.737737 17867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:20.737763 17867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:20.737784 17867 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:20.737812 17867 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:20.742885 17867 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:39625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:35165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:20.743836 17867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:20.744820 17867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:20.752782 17878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:20.752974 17867 server_base.cc:1034] running on GCE node
W20260810 01:46:20.752792 17875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:20.752782 17874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:20.753633 17867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:20.754609 17867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:20.755770 17867 hybrid_clock.cc:648] HybridClock initialized: now 1786326380755758 us; error 26 us; skew 500 ppm
Aug 10 01:46:20 dist-test-slave-jlzn krb5kdc[17849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326380, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:20.758304 17867 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:46:20.759123 17867 webserver.cc:460] Webserver started at http://127.16.58.126:41653/ using document root <none> and password file <none>
I20260810 01:46:20.759625 17867 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:20.759692 17867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:20.759927 17867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:20.761849 17867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "b392aa8f18a64fce98ee23ae3f57ec5f"
format_stamp: "Formatted at 2026-08-10 01:46:20 on dist-test-slave-jlzn"
server_key: "3bf134af9825a02e32d5e63c0d76c252"
server_key_iv: "0666cb254f75a6da62e15b828c4cb948"
server_key_version: "encryptionkey@0"
I20260810 01:46:20.762377 17867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "b392aa8f18a64fce98ee23ae3f57ec5f"
format_stamp: "Formatted at 2026-08-10 01:46:20 on dist-test-slave-jlzn"
server_key: "3bf134af9825a02e32d5e63c0d76c252"
server_key_iv: "0666cb254f75a6da62e15b828c4cb948"
server_key_version: "encryptionkey@0"
I20260810 01:46:20.765827 17867 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260810 01:46:20.768041 17888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:20.769161 17867 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260810 01:46:20.769274 17867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "b392aa8f18a64fce98ee23ae3f57ec5f"
format_stamp: "Formatted at 2026-08-10 01:46:20 on dist-test-slave-jlzn"
server_key: "3bf134af9825a02e32d5e63c0d76c252"
server_key_iv: "0666cb254f75a6da62e15b828c4cb948"
server_key_version: "encryptionkey@0"
I20260810 01:46:20.769364 17867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:20.792682 17867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:20.795240 17867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:20.795408 17867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:20.802033 17867 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:35165
I20260810 01:46:20.802055 17983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:35165 every 8 connection(s)
I20260810 01:46:20.802889 17867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:20.805528 17984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:20.810809 17984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f: Bootstrap starting.
I20260810 01:46:20.812064 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 17867
I20260810 01:46:20.812217 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:20.812486 16617 external_mini_cluster.cc:1428] Setting key 11db1e85b20f8a0418ffcc16275ce878
I20260810 01:46:20.813539 17984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:20.814263 17984 log.cc:824] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:20.816228 17984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f: No bootstrap required, opened a new log
I20260810 01:46:20.820155 17984 raft_consensus.cc:348] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b392aa8f18a64fce98ee23ae3f57ec5f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35165 } }
I20260810 01:46:20.820364 17984 raft_consensus.cc:374] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:20.820420 17984 raft_consensus.cc:729] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b392aa8f18a64fce98ee23ae3f57ec5f, State: Initialized, Role: FOLLOWER
I20260810 01:46:20.820787 17987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:20.813517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50031 (local address 127.16.58.126:35165)
0810 01:46:20.813910 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:20.813927 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:20.813976 (+ 49us) server_negotiation.cc:407] Connection header received
0810 01:46:20.814617 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:20.814640 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:20.815042 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:20.815315 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:20.815638 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:20.816649 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:20.817824 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:20.818273 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:20.818378 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:20.819174 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:20.819179 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:20.819191 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:20.819538 (+ 347us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:20.819589 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:20.819610 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:20.819685 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:20.819859 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 01:46:20.820054 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":126,"threads_started":1}
I20260810 01:46:20.820838 17984 consensus_queue.cc:260] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b392aa8f18a64fce98ee23ae3f57ec5f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35165 } }
I20260810 01:46:20.820995 17984 raft_consensus.cc:388] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:20.821056 17984 raft_consensus.cc:482] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:20.821153 17984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:20.822045 17984 raft_consensus.cc:504] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b392aa8f18a64fce98ee23ae3f57ec5f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35165 } }
I20260810 01:46:20.822389 17984 leader_election.cc:302] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b392aa8f18a64fce98ee23ae3f57ec5f; no voters:
I20260810 01:46:20.822737 17984 leader_election.cc:288] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:20.822819 17989 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:20.823045 17989 raft_consensus.cc:686] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [term 1 LEADER]: Becoming Leader. State: Replica: b392aa8f18a64fce98ee23ae3f57ec5f, State: Running, Role: LEADER
I20260810 01:46:20.823406 17989 consensus_queue.cc:237] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b392aa8f18a64fce98ee23ae3f57ec5f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35165 } }
I20260810 01:46:20.823535 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:20.824015 17984 sys_catalog.cc:564] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:20.824579 17993 sys_catalog.cc:455] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b392aa8f18a64fce98ee23ae3f57ec5f. Latest consensus state: current_term: 1 leader_uuid: "b392aa8f18a64fce98ee23ae3f57ec5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b392aa8f18a64fce98ee23ae3f57ec5f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35165 } } }
I20260810 01:46:20.824721 17993 sys_catalog.cc:458] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:20.825389 17990 sys_catalog.cc:455] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b392aa8f18a64fce98ee23ae3f57ec5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b392aa8f18a64fce98ee23ae3f57ec5f" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35165 } } }
I20260810 01:46:20.826072 17990 sys_catalog.cc:458] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f [sys.catalog]: This master's current role is: LEADER
W20260810 01:46:20.829125 18017 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:20.829207 18017 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:20.829303 18002 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:20.829841 17987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:20.825757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39149 (local address 127.16.58.126:35165)
0810 01:46:20.825854 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:20.825858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:20.826263 (+ 405us) server_negotiation.cc:407] Connection header received
0810 01:46:20.826631 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:20.826634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:20.826688 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:20.826764 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:20.827007 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:20.827496 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:20.828305 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:20.828522 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:20.828607 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:20.829399 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:20.829404 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:20.829406 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:20.829420 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:20.829447 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:20.829459 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:20.829539 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:20.829665 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 01:46:20.829717 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 01:46:20.830255 18002 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:20.835608 18002 catalog_manager.cc:1347] Generated new cluster ID: 5442225b69814b24abc2a9679c27e9ad
I20260810 01:46:20.835680 18002 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:20.842152 18002 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:20.842964 18002 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:20.850574 18002 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b392aa8f18a64fce98ee23ae3f57ec5f: Generated new TSK 0
I20260810 01:46:20.851173 18002 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:20.858821 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 17867
2026-08-10T01:46:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1486 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:20 dist-test-slave-jlzn krb5kdc[18030](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:20 dist-test-slave-jlzn krb5kdc[18030](info): set up 2 sockets
Aug 10 01:46:20 dist-test-slave-jlzn krb5kdc[18030](info): commencing operation
krb5kdc: starting...
W20260810 01:46:21.994428 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:22 dist-test-slave-jlzn krb5kdc[18030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326382, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:46:22.111900 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:46023
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:42661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:46023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:22.220116 18054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:22.220378 18054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:22.220438 18054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:22.224388 18054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:22.224449 18054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:22.224474 18054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:22.224495 18054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:22.224524 18054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:22.229708 18054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:42661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:46023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:46023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:22.230712 18054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:22.231694 18054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:22.239782 18062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:22.239773 18066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:22.239871 18063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:22.239997 18054 server_base.cc:1034] running on GCE node
I20260810 01:46:22.240619 18054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:22.241606 18054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:22.242770 18054 hybrid_clock.cc:648] HybridClock initialized: now 1786326382242753 us; error 27 us; skew 500 ppm
Aug 10 01:46:22 dist-test-slave-jlzn krb5kdc[18030](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326382, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:22.245342 18054 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:46:22.246184 18054 webserver.cc:460] Webserver started at http://127.16.58.126:43583/ using document root <none> and password file <none>
I20260810 01:46:22.246739 18054 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:22.246803 18054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:22.247000 18054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:22.248982 18054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0"
format_stamp: "Formatted at 2026-08-10 01:46:22 on dist-test-slave-jlzn"
server_key: "12ab4f11821789f3df576875b83dd3ae"
server_key_iv: "0844e286c899f36f9a2fd4b62b097650"
server_key_version: "encryptionkey@0"
I20260810 01:46:22.249502 18054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0"
format_stamp: "Formatted at 2026-08-10 01:46:22 on dist-test-slave-jlzn"
server_key: "12ab4f11821789f3df576875b83dd3ae"
server_key_iv: "0844e286c899f36f9a2fd4b62b097650"
server_key_version: "encryptionkey@0"
I20260810 01:46:22.253083 18054 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 01:46:22.255239 18078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:22.256389 18054 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:46:22.256505 18054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0"
format_stamp: "Formatted at 2026-08-10 01:46:22 on dist-test-slave-jlzn"
server_key: "12ab4f11821789f3df576875b83dd3ae"
server_key_iv: "0844e286c899f36f9a2fd4b62b097650"
server_key_version: "encryptionkey@0"
I20260810 01:46:22.256594 18054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:22.260931 18054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:22.263476 18054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:22.263648 18054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:22.270432 18054 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:46023
I20260810 01:46:22.270447 18153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:46023 every 8 connection(s)
I20260810 01:46:22.271283 18054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:22.273926 18154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:22.277076 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18054
I20260810 01:46:22.277204 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:22.277431 16617 external_mini_cluster.cc:1428] Setting key 3881653ba83da3d9f57d425f9217f984
I20260810 01:46:22.279603 18154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0: Bootstrap starting.
I20260810 01:46:22.281981 18154 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:22.282231 18157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:22.278695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39481 (local address 127.16.58.126:46023)
0810 01:46:22.279065 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:22.279080 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:22.279115 (+ 35us) server_negotiation.cc:407] Connection header received
0810 01:46:22.279726 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:22.279747 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:22.280054 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:22.280312 (+ 258us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:22.281083 (+ 771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:22.281088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:22.281099 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:22.281109 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:22.281173 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:22.281193 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:22.281297 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:22.281408 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 01:46:22.281547 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":92,"threads_started":1}
I20260810 01:46:22.282822 18154 log.cc:824] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:22.284868 18154 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0: No bootstrap required, opened a new log
I20260810 01:46:22.284937 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:22.288456 18157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:22.286756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33435 (local address 127.16.58.126:46023)
0810 01:46:22.286844 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:22.286849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:22.287042 (+ 193us) server_negotiation.cc:407] Connection header received
0810 01:46:22.287140 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:22.287143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:22.287173 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:22.287233 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:22.287938 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:22.287941 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:22.287944 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 01:46:22.287972 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:22.287999 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 01:46:22.288011 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:22.288085 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:22.288329 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 01:46:22.288366 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 01:46:22.288853 18154 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46023 } }
I20260810 01:46:22.289113 18154 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 01:46:22.289199 18154 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8acad3da3b84fdfb5d0e0f6f2467ce0, State: Initialized, Role: FOLLOWER
I20260810 01:46:22.289606 18154 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46023 } }
I20260810 01:46:22.289733 18154 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 01:46:22.289798 18154 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 01:46:22.289892 18154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:22.290700 18154 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46023 } }
I20260810 01:46:22.291005 18154 leader_election.cc:302] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8acad3da3b84fdfb5d0e0f6f2467ce0; no voters:
I20260810 01:46:22.291270 18154 leader_election.cc:288] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 01:46:22.291359 18166 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:22.291548 18166 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [term 1 LEADER]: Becoming Leader. State: Replica: f8acad3da3b84fdfb5d0e0f6f2467ce0, State: Running, Role: LEADER
I20260810 01:46:22.291896 18166 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46023 } }
I20260810 01:46:22.292418 18154 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:22.293478 18169 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8acad3da3b84fdfb5d0e0f6f2467ce0. Latest consensus state: current_term: 1 leader_uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46023 } } }
I20260810 01:46:22.293627 18169 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:22.293475 18168 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8acad3da3b84fdfb5d0e0f6f2467ce0" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 46023 } } }
I20260810 01:46:22.293886 18168 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0 [sys.catalog]: This master's current role is: LEADER
W20260810 01:46:22.296754 18191 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:22.296816 18191 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:22.296890 18181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:22.297775 18181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:22.302860 18181 catalog_manager.cc:1347] Generated new cluster ID: 2ce950b0685d421babdd2eeb86e7c2b7
I20260810 01:46:22.302919 18181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:22.317754 18181 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:22.318019 18181 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:22.322003 18181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8acad3da3b84fdfb5d0e0f6f2467ce0: Generated new TSK 0
I20260810 01:46:22.322779 18181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 01:46:22.334604 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18054
2026-08-10T01:46:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1477 ms)
[----------] 18 tests from AuthTokenIssuingTest (26622 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:22 dist-test-slave-jlzn krb5kdc[18199](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:22 dist-test-slave-jlzn krb5kdc[18199](info): set up 2 sockets
Aug 10 01:46:22 dist-test-slave-jlzn krb5kdc[18199](info): commencing operation
krb5kdc: starting...
W20260810 01:46:23.481208 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:23 dist-test-slave-jlzn krb5kdc[18199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:46:23.596537 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38677
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:43833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:38677,127.16.58.125:39403,127.16.58.124:43755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:23.704025 18215 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:46:23.704308 18215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:23.704350 18215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:23.704412 18215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:23.708436 18215 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:23.708493 18215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:23.708555 18215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:23.708590 18215 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:23.708616 18215 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:23.713812 18215 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:38677,127.16.58.125:39403,127.16.58.124:43755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:38677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:23.714793 18215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:23.715777 18215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:23.724009 18220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:23.723974 18215 server_base.cc:1034] running on GCE node
W20260810 01:46:23.723953 18221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:23.723991 18226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:23.724714 18215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:23.725730 18215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:23.726905 18215 hybrid_clock.cc:648] HybridClock initialized: now 1786326383726888 us; error 27 us; skew 500 ppm
Aug 10 01:46:23 dist-test-slave-jlzn krb5kdc[18199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:23.729527 18215 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:46:23.730355 18215 webserver.cc:460] Webserver started at http://127.16.58.126:46201/ using document root <none> and password file <none>
I20260810 01:46:23.730880 18215 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:23.730947 18215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:23.731164 18215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:23.733197 18215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "0e0d8192ecdd403f8a28ef2c634b0746"
format_stamp: "Formatted at 2026-08-10 01:46:23 on dist-test-slave-jlzn"
server_key: "ef39e9057dc34c6aaf3bf1efae377d68"
server_key_iv: "03e7da1f0d80a047ca2a72b55059f9e8"
server_key_version: "encryptionkey@0"
I20260810 01:46:23.733752 18215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "0e0d8192ecdd403f8a28ef2c634b0746"
format_stamp: "Formatted at 2026-08-10 01:46:23 on dist-test-slave-jlzn"
server_key: "ef39e9057dc34c6aaf3bf1efae377d68"
server_key_iv: "03e7da1f0d80a047ca2a72b55059f9e8"
server_key_version: "encryptionkey@0"
I20260810 01:46:23.737234 18215 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 01:46:23.739415 18239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:23.740593 18215 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260810 01:46:23.740715 18215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "0e0d8192ecdd403f8a28ef2c634b0746"
format_stamp: "Formatted at 2026-08-10 01:46:23 on dist-test-slave-jlzn"
server_key: "ef39e9057dc34c6aaf3bf1efae377d68"
server_key_iv: "03e7da1f0d80a047ca2a72b55059f9e8"
server_key_version: "encryptionkey@0"
I20260810 01:46:23.740805 18215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:23.759323 18215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:23.761960 18215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:23.762128 18215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:23.768877 18215 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:38677
I20260810 01:46:23.769120 18318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:38677 every 8 connection(s)
I20260810 01:46:23.769804 18215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:23.771876 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18215
I20260810 01:46:23.771999 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:23.772255 16617 external_mini_cluster.cc:1428] Setting key c513c32f57e966408511dbc5841d5742
I20260810 01:46:23.772627 18322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:23.776780 18322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.58.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.125@KRBTEST.COM" created.
Aug 10 01:46:23 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:46:23.790793 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.778997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38677 (local address 127.0.0.1:54760)
0810 01:46:23.779505 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:23.779540 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:23.780343 (+ 803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:23.780960 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:23.780966 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:23.781375 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:23.781602 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:23.781614 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.782730 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.782733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:23.783460 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:23.783469 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.784171 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.784175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:23.784351 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:23.784955 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:23.784970 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:23.786305 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:23.788191 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:23.788199 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:23.788208 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:23.788412 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:23.788707 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:23.788710 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:23.788713 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:23.788816 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:23.789334 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:23.789340 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:23.789464 (+ 124us) client_negotiation.cc:769] Sending connection context
0810 01:46:23.789599 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 01:46:23.789923 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":88,"thread_start_us":141,"threads_started":1}
I20260810 01:46:23.790793 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.778996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54760 (local address 127.16.58.126:38677)
0810 01:46:23.779379 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:23.779398 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:23.779638 (+ 240us) server_negotiation.cc:407] Connection header received
0810 01:46:23.780620 (+ 982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:23.780624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:23.780790 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:23.780943 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:23.781747 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.782610 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.783611 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.784019 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.784148 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:23.786461 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:23.786468 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:23.786480 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:23.786543 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:23.788093 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:23.788509 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:23.788514 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:23.788515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:23.788614 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:23.788897 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:23.788900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:23.788902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:23.789230 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:23.789342 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:23.789687 (+ 345us) server_negotiation.cc:299] Negotiation successful
0810 01:46:23.789861 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":246,"thread_start_us":99,"threads_started":1}
I20260810 01:46:23.793043 18322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:46:23.793715 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.793458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:39403 (local address 127.0.0.1:33696)
0810 01:46:23.793592 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:23.793658 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260810 01:46:23.793890 18245 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
I20260810 01:46:23.794662 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.794468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:39403 (local address 127.0.0.1:33712)
0810 01:46:23.794567 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:23.794610 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 01:46:23.794780 18322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.125:39403: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab.
Entry for principal kudu/127.16.58.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab.
I20260810 01:46:23.796304 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.125:39403
--webserver_interface=127.16.58.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab
--principal=kudu/127.16.58.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:43833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:38677,127.16.58.125:39403,127.16.58.124:43755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:46:23.843988 18322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } attempt: 1
I20260810 01:46:23.844787 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.844501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:39403 (local address 127.0.0.1:33726)
0810 01:46:23.844644 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:23.844708 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 01:46:23.845508 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.845294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:39403 (local address 127.0.0.1:33728)
0810 01:46:23.845397 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:23.845443 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 01:46:23.845711 18322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.125:39403: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
W20260810 01:46:23.904665 18334 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:46:23.904906 18334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:23.904930 18334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:23.904992 18334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:23.908851 18334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:23.908900 18334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:23.908921 18334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:23.908949 18334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:23.908975 18334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:23.913877 18322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } attempt: 2
I20260810 01:46:23.914103 18334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:38677,127.16.58.125:39403,127.16.58.124:43755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab
--principal=kudu/127.16.58.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.125:39403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.58.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:23.914671 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.914390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:39403 (local address 127.0.0.1:33730)
0810 01:46:23.914530 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:23.914594 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 01:46:23.915091 18334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:23.915331 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.915127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:39403 (local address 127.0.0.1:33744)
0810 01:46:23.915225 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:23.915273 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 01:46:23.915442 18322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.125:39403: Network error: Client connection negotiation failed: client connection to 127.16.58.125:39403: connect: Connection refused (error 111)
I20260810 01:46:23.916111 18334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:23.924289 18343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:23.924345 18339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:23.924398 18341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:23.924428 18334 server_base.cc:1034] running on GCE node
I20260810 01:46:23.925155 18334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:23.926128 18334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:23.927290 18334 hybrid_clock.cc:648] HybridClock initialized: now 1786326383927272 us; error 28 us; skew 500 ppm
Aug 10 01:46:23 dist-test-slave-jlzn krb5kdc[18199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:23.929833 18334 init.cc:377] Logged in from keytab as kudu/127.16.58.125@KRBTEST.COM (short username kudu)
I20260810 01:46:23.930663 18334 webserver.cc:460] Webserver started at http://127.16.58.125:42539/ using document root <none> and password file <none>
I20260810 01:46:23.931171 18334 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:23.931238 18334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:23.931429 18334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:23.933416 18334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/data/instance:
uuid: "6557e5a8f9444d869107d2eadcfccf43"
format_stamp: "Formatted at 2026-08-10 01:46:23 on dist-test-slave-jlzn"
server_key: "8030cb80e3b5cff4f2cb0a3cf49465b3"
server_key_iv: "c7182cdf35d3da4e81e262981c763be8"
server_key_version: "encryptionkey@0"
I20260810 01:46:23.933976 18334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/wal/instance:
uuid: "6557e5a8f9444d869107d2eadcfccf43"
format_stamp: "Formatted at 2026-08-10 01:46:23 on dist-test-slave-jlzn"
server_key: "8030cb80e3b5cff4f2cb0a3cf49465b3"
server_key_iv: "c7182cdf35d3da4e81e262981c763be8"
server_key_version: "encryptionkey@0"
I20260810 01:46:23.937721 18334 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260810 01:46:23.939992 18352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:23.941169 18334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260810 01:46:23.941279 18334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/wal
uuid: "6557e5a8f9444d869107d2eadcfccf43"
format_stamp: "Formatted at 2026-08-10 01:46:23 on dist-test-slave-jlzn"
server_key: "8030cb80e3b5cff4f2cb0a3cf49465b3"
server_key_iv: "c7182cdf35d3da4e81e262981c763be8"
server_key_version: "encryptionkey@0"
I20260810 01:46:23.941371 18334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:23.959311 18334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:23.961839 18334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:23.962008 18334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:23.968539 18334 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.125:39403
I20260810 01:46:23.968808 18442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.125:39403 every 8 connection(s)
I20260810 01:46:23.969465 18334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
I20260810 01:46:23.972081 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18334
I20260810 01:46:23.972227 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-1/wal/instance
I20260810 01:46:23.972312 18443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:23.972560 16617 external_mini_cluster.cc:1428] Setting key aa1ae1aac99fe5ded8e12016debe4f99
I20260810 01:46:23.976498 18443 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.58.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.124@KRBTEST.COM" created.
Aug 10 01:46:23 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:46:23.990082 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.978324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54772 (local address 127.16.58.126:38677)
0810 01:46:23.978482 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:23.978487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:23.979279 (+ 792us) server_negotiation.cc:407] Connection header received
0810 01:46:23.980416 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:23.980418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:23.980466 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:23.980536 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:23.981932 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.982536 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.983613 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.983967 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.984081 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:23.986364 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:23.986367 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:23.986369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:23.986394 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:23.987943 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:23.988443 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:23.988446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:23.988448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:23.988548 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:23.988898 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:23.988902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:23.988904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:23.989159 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:23.989274 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:23.989781 (+ 507us) server_negotiation.cc:299] Negotiation successful
0810 01:46:23.989912 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 01:46:23.990761 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.978610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38677 (local address 127.0.0.1:54772)
0810 01:46:23.979093 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:23.979160 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:23.980207 (+ 1047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:23.980734 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:23.980744 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:23.981192 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:23.981800 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:23.981816 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.982639 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.982642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:23.983484 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:23.983493 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.984126 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.984141 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:23.984331 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:23.984850 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:23.984866 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:23.986205 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:23.988054 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:23.988059 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:23.988069 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:23.988323 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:23.988642 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:23.988645 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:23.988646 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:23.988785 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:23.989303 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:23.989308 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:23.989542 (+ 234us) client_negotiation.cc:769] Sending connection context
0810 01:46:23.989696 (+ 154us) client_negotiation.cc:240] Negotiation successful
0810 01:46:23.989933 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":104,"threads_started":1}
I20260810 01:46:23.992137 18443 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:46:23 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab.
Entry for principal kudu/127.16.58.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab.
I20260810 01:46:23.999051 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.124:43755
--webserver_interface=127.16.58.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab
--principal=kudu/127.16.58.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:43833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:38677,127.16.58.125:39403,127.16.58.124:43755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:46:24.000643 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.992602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:39403 (local address 127.0.0.1:33756)
0810 01:46:23.992703 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:23.992715 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:23.992775 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:23.993333 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:23.993335 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:23.993497 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:23.993602 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:23.993609 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.994594 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.994597 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:23.995165 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:23.995174 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.995751 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.995754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:23.995861 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:23.996277 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:23.996290 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:23.997464 (+ 1174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:23.999168 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:23.999172 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:23.999174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:23.999402 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:23.999676 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:23.999678 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:23.999680 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:23.999772 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.000218 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:24.000221 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:24.000323 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 01:46:24.000431 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 01:46:24.000536 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 01:46:24.000969 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:23.992723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33756 (local address 127.16.58.125:39403)
0810 01:46:23.992979 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:23.992987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:23.993004 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:46:23.993054 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:23.993058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:23.993222 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:23.993332 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:23.993731 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.994477 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.995289 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:23.995648 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:23.995728 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:23.997586 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:23.997595 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:23.997605 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:23.997626 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:23.999052 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:23.999508 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:23.999513 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:23.999514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:23.999594 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:23.999886 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:23.999888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:23.999889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.000119 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.000225 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.000530 (+ 305us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.000675 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":94,"threads_started":1}
I20260810 01:46:24.002817 18443 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:46:24.003520 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.003244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57904)
0810 01:46:24.003357 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.003441 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260810 01:46:24.003706 18358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
I20260810 01:46:24.004550 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.004309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57912)
0810 01:46:24.004423 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.004477 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 01:46:24.004706 18443 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:43755: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
I20260810 01:46:24.006608 18322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } attempt: 3
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
I20260810 01:46:24.015614 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.007033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:39403 (local address 127.0.0.1:33768)
0810 01:46:24.007145 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.007159 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:24.007227 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:24.007470 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:24.007472 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:24.007618 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:24.007704 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.007709 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.008688 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.008690 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.009612 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.009622 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.010201 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.010203 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.010277 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.010675 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:24.010687 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:24.012029 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:24.014418 (+ 2389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.014420 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.014422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.014612 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.014845 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.014846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.014848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.014911 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.015245 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:24.015247 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:24.015321 (+ 74us) client_negotiation.cc:769] Sending connection context
0810 01:46:24.015392 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 01:46:24.015490 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 01:46:24.015704 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.007083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33768 (local address 127.16.58.125:39403)
0810 01:46:24.007193 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.007198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.007213 (+ 15us) server_negotiation.cc:407] Connection header received
0810 01:46:24.007293 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.007296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.007349 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.007429 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.007827 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.008587 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.009730 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.010105 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.010208 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.012159 (+ 1951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.012163 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.012165 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.012192 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.014307 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.014688 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.014691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.014693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.014774 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.014977 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.014980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.014982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.015172 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.015261 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.015449 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.015565 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:46:24.016518 18322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:46:24.017148 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.016930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57914)
0810 01:46:24.017038 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.017087 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 01:46:24.017812 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.017588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57918)
0810 01:46:24.017719 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.017761 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260810 01:46:24.017940 18322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:43755: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
I20260810 01:46:24.049115 18322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } attempt: 1
I20260810 01:46:24.049919 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.049637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57934)
0810 01:46:24.049784 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.049842 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 01:46:24.050643 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.050446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57942)
0810 01:46:24.050532 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.050576 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 01:46:24.050762 18322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:43755: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
I20260810 01:46:24.053936 18443 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } attempt: 1
I20260810 01:46:24.054593 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.054356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57954)
0810 01:46:24.054477 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.054527 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 01:46:24.055241 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.055053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57968)
0810 01:46:24.055146 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.055187 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 01:46:24.055358 18443 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:43755: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
W20260810 01:46:24.113317 18449 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:46:24.113570 18449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:24.113592 18449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:24.113633 18449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:24.117437 18449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:24.117482 18449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:24.117499 18449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:24.117514 18449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:24.117533 18449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:24.122582 18449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:38677,127.16.58.125:39403,127.16.58.124:43755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab
--principal=kudu/127.16.58.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.124:43755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.58.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:24.123482 18449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:24.123489 18443 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } attempt: 2
I20260810 01:46:24.124326 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.124049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57984)
0810 01:46:24.124192 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.124252 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 01:46:24.124644 18449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:46:24.125010 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.124805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:57998)
0810 01:46:24.124903 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.124949 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 01:46:24.125138 18443 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:43755: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
I20260810 01:46:24.125895 18322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } attempt: 2
I20260810 01:46:24.126508 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.126286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:58014)
0810 01:46:24.126400 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.126446 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 01:46:24.127110 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.126916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:58020)
0810 01:46:24.127008 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.127050 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 01:46:24.127220 18322 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:43755: Network error: Client connection negotiation failed: client connection to 127.16.58.124:43755: connect: Connection refused (error 111)
W20260810 01:46:24.133013 18457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:24.133045 18458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:24.133209 18449 server_base.cc:1034] running on GCE node
W20260810 01:46:24.133020 18461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:24.133746 18449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:24.134740 18449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:24.135874 18449 hybrid_clock.cc:648] HybridClock initialized: now 1786326384135858 us; error 24 us; skew 500 ppm
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326384, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:24.138417 18449 init.cc:377] Logged in from keytab as kudu/127.16.58.124@KRBTEST.COM (short username kudu)
I20260810 01:46:24.139236 18449 webserver.cc:460] Webserver started at http://127.16.58.124:43871/ using document root <none> and password file <none>
I20260810 01:46:24.139725 18449 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:24.139782 18449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:24.139989 18449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:24.141865 18449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/data/instance:
uuid: "05da3095d004485c9ed08c1ac874276e"
format_stamp: "Formatted at 2026-08-10 01:46:24 on dist-test-slave-jlzn"
server_key: "de30042bdd4c218037a4bda8ef97ae97"
server_key_iv: "ad2af312001930ff220665f7831794fe"
server_key_version: "encryptionkey@0"
I20260810 01:46:24.142367 18449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/wal/instance:
uuid: "05da3095d004485c9ed08c1ac874276e"
format_stamp: "Formatted at 2026-08-10 01:46:24 on dist-test-slave-jlzn"
server_key: "de30042bdd4c218037a4bda8ef97ae97"
server_key_iv: "ad2af312001930ff220665f7831794fe"
server_key_version: "encryptionkey@0"
I20260810 01:46:24.145900 18449 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260810 01:46:24.148140 18474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:24.149256 18449 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260810 01:46:24.149354 18449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/wal
uuid: "05da3095d004485c9ed08c1ac874276e"
format_stamp: "Formatted at 2026-08-10 01:46:24 on dist-test-slave-jlzn"
server_key: "de30042bdd4c218037a4bda8ef97ae97"
server_key_iv: "ad2af312001930ff220665f7831794fe"
server_key_version: "encryptionkey@0"
I20260810 01:46:24.149433 18449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:24.162075 18449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:24.164541 18449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:24.164680 18449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:24.171145 18449 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.124:43755
I20260810 01:46:24.171412 18575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.124:43755 every 8 connection(s)
I20260810 01:46:24.172109 18449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
I20260810 01:46:24.174723 18576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:24.175222 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18449
I20260810 01:46:24.175321 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786326110151381-16617-0/minicluster-data/master-2/wal/instance
I20260810 01:46:24.175561 16617 external_mini_cluster.cc:1428] Setting key f41a2e01f7660baa1d8e9782c5bd84bd
I20260810 01:46:24.179332 18576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326384, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:46:24.189262 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.176838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58032 (local address 127.16.58.124:43755)
0810 01:46:24.177236 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.177251 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.177285 (+ 34us) server_negotiation.cc:407] Connection header received
0810 01:46:24.177955 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.177971 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.178269 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.178530 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.179423 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.180449 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.181413 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.181982 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.182136 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.184689 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.184696 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.184708 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.184739 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.186325 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.186763 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.186769 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.186774 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.186902 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.187171 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.187174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.187175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.187667 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.187888 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.188107 (+ 219us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.188382 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":264,"thread_start_us":108,"threads_started":1}
I20260810 01:46:24.189944 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.181051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54784 (local address 127.16.58.126:38677)
0810 01:46:24.181203 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.181207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.181413 (+ 206us) server_negotiation.cc:407] Connection header received
0810 01:46:24.181607 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.181611 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.181675 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.181752 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.182416 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.183096 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.184016 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.184278 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.184391 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.186682 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.186685 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.186686 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.186712 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.188311 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.188716 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.188719 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.188721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.188808 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.189023 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.189026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.189028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.189254 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.189353 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.189699 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.189806 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 01:46:24.189956 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.180941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:38677 (local address 127.0.0.1:54784)
0810 01:46:24.181292 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.181340 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:24.181500 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:24.181805 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:24.181809 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:24.182118 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:24.182296 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.182302 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.183240 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.183243 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.183897 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.183906 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.184422 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.184425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.184513 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.184956 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:24.184972 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:24.186541 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:24.188410 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.188418 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.188422 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.188628 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.188885 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.188887 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.188888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.188953 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.189353 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:24.189358 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:24.189477 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 01:46:24.189615 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 01:46:24.189787 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":39,"thread_start_us":111,"threads_started":1}
I20260810 01:46:24.190979 18576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326384, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:46:24.198776 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.191704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33784 (local address 127.16.58.125:39403)
0810 01:46:24.191842 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.191847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.191859 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:46:24.191898 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.191900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.191938 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.191998 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.192379 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.192850 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.193549 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.193761 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.193837 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.195856 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.195860 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.195862 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.195888 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.197305 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.197692 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.197695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.197696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.197787 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.198045 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.198048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.198050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.198278 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.198381 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.198572 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.198667 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:46:24.198774 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.191409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:39403 (local address 127.0.0.1:33784)
0810 01:46:24.191518 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.191531 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:24.191590 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:24.192048 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:24.192052 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:24.192196 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:24.192288 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.192295 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.192927 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.192930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.193434 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.193440 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.193855 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.193859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.193959 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.194349 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:24.194361 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:24.195694 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:24.197420 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.197423 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.197424 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.197601 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.197882 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.197884 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.197886 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.197966 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.198360 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:24.198362 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:24.198428 (+ 66us) client_negotiation.cc:769] Sending connection context
0810 01:46:24.198509 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 01:46:24.198626 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 01:46:24.199417 18576 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:46:24.200601 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.191319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54796 (local address 127.16.58.126:38677)
0810 01:46:24.191420 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.191424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.191437 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:46:24.191580 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.191583 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.191626 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.191701 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.192959 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.193409 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.194274 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.194513 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.194585 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.197002 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.197006 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.197009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.197035 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.198431 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.199237 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.199240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.199242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.199324 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.199607 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.199611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.199613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.199873 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.200070 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.200364 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.200463 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326384, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
I20260810 01:46:24.206969 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.199876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:58048)
0810 01:46:24.199962 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.199974 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:24.200042 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:24.200235 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:24.200238 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:24.200373 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:24.200430 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.200435 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.201495 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.201498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.201980 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.201987 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.202393 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.202396 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.202492 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.202851 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:24.202864 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:24.203987 (+ 1123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:24.205600 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.205603 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.205605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.205844 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.206079 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.206083 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.206085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.206187 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.206514 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:24.206516 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:24.206590 (+ 74us) client_negotiation.cc:769] Sending connection context
0810 01:46:24.206669 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 01:46:24.206778 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":16}
I20260810 01:46:24.207002 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.199908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58048 (local address 127.16.58.124:43755)
0810 01:46:24.199992 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.199996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.200008 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:46:24.200114 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.200117 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.200150 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.200214 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.200523 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.201394 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.202075 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.202301 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.202385 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.204096 (+ 1711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.204100 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.204102 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.204127 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.205498 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.205925 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.205927 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.205928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.205997 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.206270 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.206272 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.206273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.206422 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.206512 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.206743 (+ 231us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.206832 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":39}
I20260810 01:46:24.209359 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.201670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33796 (local address 127.16.58.125:39403)
0810 01:46:24.201778 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.201781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.201792 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:46:24.201821 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.201823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.201853 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.201911 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.202445 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.202904 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.203600 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.203936 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.204044 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.206483 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.206487 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.206490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.206512 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.207956 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.208313 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.208316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.208318 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.208393 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.208625 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.208628 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.208630 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.208789 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.209001 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.209116 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.209220 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:46:24.209996 18576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e: Bootstrap starting.
I20260810 01:46:24.212468 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:24.212646 18576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:24.213397 18576 log.cc:824] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:24.213832 18282 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "0e0d8192ecdd403f8a28ef2c634b0746"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54796
I20260810 01:46:24.215225 18576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e: No bootstrap required, opened a new log
I20260810 01:46:24.216285 18443 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } attempt: 3
I20260810 01:46:24.219048 18576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } }
I20260810 01:46:24.219252 18576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05da3095d004485c9ed08c1ac874276e, State: Initialized, Role: FOLLOWER
I20260810 01:46:24.219596 18576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } }
I20260810 01:46:24.220122 18583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.220256 18583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:24.220901 18576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [sys.catalog]: configured and running, proceeding with master startup.
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
I20260810 01:46:24.225229 18446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.216683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:58064)
0810 01:46:24.216779 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.216793 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:24.216866 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:24.217081 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:24.217084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:24.217267 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:24.217359 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.217365 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.218288 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.218290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.219152 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.219160 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.219685 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.219689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.219771 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.220268 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:24.220282 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:24.221750 (+ 1468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:24.223593 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.223597 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.223599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.223884 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.224183 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.224186 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.224188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.224283 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.224736 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:24.224739 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:24.224834 (+ 95us) client_negotiation.cc:769] Sending connection context
0810 01:46:24.224932 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 01:46:24.225055 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 01:46:24.225768 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.216730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58064 (local address 127.16.58.124:43755)
0810 01:46:24.216847 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.216851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.216867 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:46:24.216937 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.216940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.216981 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.217074 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.217462 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.218198 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.219265 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.219571 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.219675 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.221888 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.221892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.221894 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.221919 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.223475 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.223971 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.223975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.223977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.224070 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.224389 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.224393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.224395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.224603 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.224689 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.225517 (+ 828us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.225628 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 01:46:24.225860 18609 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:24.225929 18609 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:24.224826 18449 master_runner.cc:186] Error getting master registration for 127.16.58.126:38677: OK, instance_id { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" instance_seqno: 1786326383766904 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:46:24.228569 18449 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 01:46:24.228829 18443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43: Bootstrap starting.
I20260810 01:46:24.231534 18443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:24.231849 18322 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } attempt: 3
I20260810 01:46:24.232470 18443 log.cc:824] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:24.234532 18443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43: No bootstrap required, opened a new log
Aug 10 01:46:24 dist-test-slave-jlzn krb5kdc[18199](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326383, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
I20260810 01:46:24.237746 18443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } }
I20260810 01:46:24.237973 18443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6557e5a8f9444d869107d2eadcfccf43, State: Initialized, Role: FOLLOWER
I20260810 01:46:24.238312 18443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } }
I20260810 01:46:24.238890 18612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.239151 18612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:24.239881 18443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:24.241281 18330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.232254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:43755 (local address 127.0.0.1:58068)
0810 01:46:24.232437 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:24.232451 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:24.232527 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:24.232868 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:24.232871 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:24.233033 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:24.233120 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.233125 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.234072 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.234076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.234907 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:24.234920 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.235494 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.235498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:24.235588 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.236119 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:24.236135 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:24.237612 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:24.239620 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.239624 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.239626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.239892 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.240224 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:24.240227 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:24.240229 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:24.240328 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:24.240771 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:24.240775 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:24.240886 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 01:46:24.240974 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 01:46:24.241109 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260810 01:46:24.241912 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.232319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58068 (local address 127.16.58.124:43755)
0810 01:46:24.232680 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.232684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.232695 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:46:24.232727 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.232730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.232767 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.232833 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.233229 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.233932 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.235052 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.235363 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.235468 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.237769 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.237773 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.237776 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.237802 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.239520 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.240029 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.240033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.240035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.240124 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.240421 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.240425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.240426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.240640 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.241577 (+ 937us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.241661 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.241772 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292}
I20260810 01:46:24.245096 18322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746: Bootstrap starting.
I20260810 01:46:24.243196 18334 master_runner.cc:186] Error getting master registration for 127.16.58.126:38677: OK, instance_id { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" instance_seqno: 1786326383766904 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:46:24.246917 18334 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 01:46:24.247141 18628 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:24.247210 18628 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:24.247689 18322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:24.248875 18322 log.cc:824] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:24.250942 18322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746: No bootstrap required, opened a new log
I20260810 01:46:24.253995 18322 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } }
I20260810 01:46:24.254200 18322 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0d8192ecdd403f8a28ef2c634b0746, State: Initialized, Role: FOLLOWER
I20260810 01:46:24.254513 18322 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } }
I20260810 01:46:24.255025 18635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.255280 18635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:24.255789 18322 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:24.255867 18282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:46:24.255957 18282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:24.257179 18282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } }
I20260810 01:46:24.258118 18282 leader_election.cc:288] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [CANDIDATE]: Term 1 election: Requested vote from peers 6557e5a8f9444d869107d2eadcfccf43 (127.16.58.125:39403), 05da3095d004485c9ed08c1ac874276e (127.16.58.124:43755)
I20260810 01:46:24.260135 18525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "05da3095d004485c9ed08c1ac874276e"
I20260810 01:46:24.260394 18525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:24.261504 18525 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0d8192ecdd403f8a28ef2c634b0746 in term 1.
I20260810 01:46:24.261927 18393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6557e5a8f9444d869107d2eadcfccf43"
I20260810 01:46:24.262122 18393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:24.263106 18393 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0d8192ecdd403f8a28ef2c634b0746 in term 1.
I20260810 01:46:24.263510 18242 leader_election.cc:302] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05da3095d004485c9ed08c1ac874276e, 0e0d8192ecdd403f8a28ef2c634b0746; no voters:
I20260810 01:46:24.263783 18635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 01:46:24.263538 18250 tablet.cc:2369] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 01:46:24.265311 18635 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0d8192ecdd403f8a28ef2c634b0746, State: Running, Role: LEADER
I20260810 01:46:24.265691 18635 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } }
I20260810 01:46:24.267464 18635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e0d8192ecdd403f8a28ef2c634b0746. Latest consensus state: current_term: 1 leader_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.267619 18635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:24.268815 18215 master_runner.cc:263] No leader master found from master 0e0d8192ecdd403f8a28ef2c634b0746
I20260810 01:46:24.269400 18215 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 01:46:24.271158 18655 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:24.271286 18655 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:24.271584 18671 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:24.272666 18671 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:24.278944 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.269229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58070 (local address 127.16.58.124:43755)
0810 01:46:24.269335 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.269340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.269580 (+ 240us) server_negotiation.cc:407] Connection header received
0810 01:46:24.269788 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.269791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.269839 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.269887 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.270890 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.271649 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.272896 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.273228 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.273306 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.275170 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.275174 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.275177 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.275206 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.276983 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.277512 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.277516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.277517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.277611 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.277936 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.277939 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.277941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.278174 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.278281 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.278661 (+ 380us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.278783 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 01:46:24.288461 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.269687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33812 (local address 127.16.58.125:39403)
0810 01:46:24.269794 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.269798 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.279560 (+ 9762us) server_negotiation.cc:407] Connection header received
0810 01:46:24.279747 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.279751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.279822 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.279874 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.280701 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.281437 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.282765 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.283114 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.283193 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.284891 (+ 1698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.284895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.284898 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.284924 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.286505 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.287027 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.287030 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.287032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.287130 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.287464 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.287467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.287469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.287686 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.287789 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.288186 (+ 397us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.288306 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:46:24.289785 18327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:24.270077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54802 (local address 127.16.58.126:38677)
0810 01:46:24.270176 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.270181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.280633 (+ 10452us) server_negotiation.cc:407] Connection header received
0810 01:46:24.280860 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.280863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.280908 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.280955 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.281834 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.282580 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.283722 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:24.284078 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:24.284151 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:24.286214 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:24.286217 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:24.286220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:24.286247 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:24.287842 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.288326 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.288329 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.288331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.288414 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:24.288736 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:24.288739 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:24.288741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:24.288940 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:24.289044 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:24.289530 (+ 486us) server_negotiation.cc:299] Negotiation successful
0810 01:46:24.289650 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:46:24.292701 18525 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [term 1 FOLLOWER]: Refusing update from remote peer 0e0d8192ecdd403f8a28ef2c634b0746: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:46:24.292892 18393 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [term 1 FOLLOWER]: Refusing update from remote peer 0e0d8192ecdd403f8a28ef2c634b0746: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:46:24.293427 18662 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:46:24.293871 18635 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:46:24.297345 18583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e0d8192ecdd403f8a28ef2c634b0746. Latest consensus state: current_term: 1 leader_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.297461 18583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:24.297603 18612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e0d8192ecdd403f8a28ef2c634b0746. Latest consensus state: current_term: 1 leader_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.297708 18612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:24.303678 18662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.303819 18662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:24.307199 18612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.307307 18612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:24.307684 18679 mvcc.cc:205] Tried to move back new op lower bound from 7316792870056390656 to 7316792869955928064. Current Snapshot: MvccSnapshot[applied={T|T < 7316792870056390656}]
I20260810 01:46:24.309581 18635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.309705 18635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746 [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:24.310596 18583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d8192ecdd403f8a28ef2c634b0746" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 38677 } } peers { permanent_uuid: "6557e5a8f9444d869107d2eadcfccf43" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 39403 } } peers { permanent_uuid: "05da3095d004485c9ed08c1ac874276e" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 43755 } } }
I20260810 01:46:24.310702 18583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:24.310774 18678 mvcc.cc:205] Tried to move back new op lower bound from 7316792870056390656 to 7316792869955928064. Current Snapshot: MvccSnapshot[applied={T|T < 7316792870056390656}]
I20260810 01:46:24.315111 18671 catalog_manager.cc:1347] Generated new cluster ID: 26b3110673cf4b77a0f1aef29839a1ca
I20260810 01:46:24.315172 18671 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:24.333214 18671 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:24.334506 18671 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:24.342626 18671 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e0d8192ecdd403f8a28ef2c634b0746: Generated new TSK 0
I20260810 01:46:24.343430 18671 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:46:24.378347 18327 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.374759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54814 (local address 127.16.58.126:38677)
0810 01:46:24.374899 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.374903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.377143 (+ 2240us) server_negotiation.cc:407] Connection header received
0810 01:46:24.377373 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.377376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.377435 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.377496 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.378196 (+ 700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54814: BlockingRecv error: recv got EOF from 127.0.0.1:54814 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260810 01:46:24.380205 18580 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.376492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58082 (local address 127.16.58.124:43755)
0810 01:46:24.376612 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.376616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.379117 (+ 2501us) server_negotiation.cc:407] Connection header received
0810 01:46:24.379408 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.379412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.379463 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.379515 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.380074 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58082: BlockingRecv error: recv got EOF from 127.0.0.1:58082 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 01:46:24.381358 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.375639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33826 (local address 127.16.58.125:39403)
0810 01:46:24.375762 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.375766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.378912 (+ 3146us) server_negotiation.cc:407] Connection header received
0810 01:46:24.380465 (+ 1553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.380469 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.380523 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.380578 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.381225 (+ 647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33826: BlockingRecv error: recv got EOF from 127.0.0.1:33826 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 01:46:24.386111 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.384569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33828 (local address 127.16.58.125:39403)
0810 01:46:24.384668 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.384672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.385151 (+ 479us) server_negotiation.cc:407] Connection header received
0810 01:46:24.385364 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.385367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.385439 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.385495 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.386006 (+ 511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33828: BlockingRecv error: recv got EOF from 127.0.0.1:33828 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 01:46:24.391017 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.389496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.16.58.125:39403)
0810 01:46:24.389592 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.389596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.390138 (+ 542us) server_negotiation.cc:407] Connection header received
0810 01:46:24.390329 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.390333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.390389 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.390441 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.390934 (+ 493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33838: BlockingRecv error: recv got EOF from 127.0.0.1:33838 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 01:46:24.396199 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.394867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33842 (local address 127.16.58.125:39403)
0810 01:46:24.394952 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.394955 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.395404 (+ 449us) server_negotiation.cc:407] Connection header received
0810 01:46:24.395553 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.395556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.395596 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.395639 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.396118 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33842: BlockingRecv error: recv got EOF from 127.0.0.1:33842 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260810 01:46:24.403379 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.401901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33848 (local address 127.16.58.125:39403)
0810 01:46:24.402023 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.402028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.402517 (+ 489us) server_negotiation.cc:407] Connection header received
0810 01:46:24.402698 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.402724 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.402784 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.402830 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.403298 (+ 468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33848: BlockingRecv error: recv got EOF from 127.0.0.1:33848 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260810 01:46:24.414790 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.413219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33860 (local address 127.16.58.125:39403)
0810 01:46:24.413317 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.413320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.413886 (+ 566us) server_negotiation.cc:407] Connection header received
0810 01:46:24.414084 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.414087 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.414136 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.414190 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.414693 (+ 503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33860: BlockingRecv error: recv got EOF from 127.0.0.1:33860 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 01:46:24.434080 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.432916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33872 (local address 127.16.58.125:39403)
0810 01:46:24.433050 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.433055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.433265 (+ 210us) server_negotiation.cc:407] Connection header received
0810 01:46:24.433403 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.433405 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.433452 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.433518 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.433963 (+ 445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33872: BlockingRecv error: recv got EOF from 127.0.0.1:33872 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 01:46:24.469739 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.468310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33888 (local address 127.16.58.125:39403)
0810 01:46:24.468458 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.468463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.468776 (+ 313us) server_negotiation.cc:407] Connection header received
0810 01:46:24.468941 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.468944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.469008 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.469103 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.469612 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33888: BlockingRecv error: recv got EOF from 127.0.0.1:33888 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260810 01:46:24.536866 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.535775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33890 (local address 127.16.58.125:39403)
0810 01:46:24.535948 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.535953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.536083 (+ 130us) server_negotiation.cc:407] Connection header received
0810 01:46:24.536243 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.536246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.536296 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.536358 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.536742 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33890: BlockingRecv error: recv got EOF from 127.0.0.1:33890 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260810 01:46:24.668057 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.666890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33906 (local address 127.16.58.125:39403)
0810 01:46:24.667031 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.667035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.667132 (+ 97us) server_negotiation.cc:407] Connection header received
0810 01:46:24.667286 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.667289 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.667337 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.667407 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.667918 (+ 511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33906: BlockingRecv error: recv got EOF from 127.0.0.1:33906 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 01:46:24.927083 18448 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:24.926001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33912 (local address 127.16.58.125:39403)
0810 01:46:24.926145 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:24.926150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:24.926222 (+ 72us) server_negotiation.cc:407] Connection header received
0810 01:46:24.926377 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:24.926380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:24.926430 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:24.926499 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:24.926978 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33912: BlockingRecv error: recv got EOF from 127.0.0.1:33912 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 01:46:25.227237 18609 catalog_manager.cc:1259] Loaded cluster ID: 26b3110673cf4b77a0f1aef29839a1ca
I20260810 01:46:25.227327 18609 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e: loading cluster ID for follower catalog manager: success
I20260810 01:46:25.229012 18609 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e: acquiring CA information for follower catalog manager: success
I20260810 01:46:25.230162 18609 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 05da3095d004485c9ed08c1ac874276e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:46:25.248445 18628 catalog_manager.cc:1259] Loaded cluster ID: 26b3110673cf4b77a0f1aef29839a1ca
I20260810 01:46:25.248508 18628 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43: loading cluster ID for follower catalog manager: success
I20260810 01:46:25.250110 18628 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43: acquiring CA information for follower catalog manager: success
I20260810 01:46:25.251240 18628 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6557e5a8f9444d869107d2eadcfccf43: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:46:25.446866 18787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:25.441579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33920 (local address 127.16.58.125:39403)
0810 01:46:25.441814 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:25.441819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:25.441899 (+ 80us) server_negotiation.cc:407] Connection header received
0810 01:46:25.442060 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:25.442063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:25.442238 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:25.442335 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:25.442615 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.443147 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.444486 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.444890 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.444988 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:25.445463 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:25.446126 (+ 663us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:25.446264 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:25.446615 (+ 351us) server_negotiation.cc:299] Negotiation successful
0810 01:46:25.446686 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":76,"threads_started":1}
I20260810 01:46:25.455047 18798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:25.450366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58090 (local address 127.16.58.124:43755)
0810 01:46:25.450608 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:25.450613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:25.450638 (+ 25us) server_negotiation.cc:407] Connection header received
0810 01:46:25.450757 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:25.450760 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:25.450903 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:25.451016 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:25.451237 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.452080 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.453317 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.453545 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.453630 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:25.454019 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:25.454628 (+ 609us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:25.454750 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:25.454815 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 01:46:25.454875 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":86,"threads_started":1}
I20260810 01:46:25.462145 18798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:25.458455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58104 (local address 127.16.58.124:43755)
0810 01:46:25.458572 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:25.458576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:25.458590 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:46:25.458631 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:25.458634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:25.458683 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:25.458748 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:25.459051 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.459691 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.460767 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.461103 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.461198 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:25.461488 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:25.461568 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:25.461632 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:25.461954 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 01:46:25.462001 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 01:46:25.462134 18787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:25.458153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33928 (local address 127.16.58.125:39403)
0810 01:46:25.458276 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:25.458281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:25.458829 (+ 548us) server_negotiation.cc:407] Connection header received
0810 01:46:25.458881 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:25.458884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:25.458930 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:25.459006 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:25.459345 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.460135 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.461112 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.461326 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.461407 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:25.461683 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:25.461750 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:25.461807 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:25.461940 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 01:46:25.461996 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 01:46:25.463323 18808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:25.458256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54820 (local address 127.16.58.126:38677)
0810 01:46:25.458725 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:25.458730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:25.458746 (+ 16us) server_negotiation.cc:407] Connection header received
0810 01:46:25.458918 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:25.458922 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:25.459080 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:25.459189 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:25.459531 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.460339 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.461496 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:25.461800 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:25.461885 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:25.462186 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:25.462792 (+ 606us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:25.462888 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:25.463137 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 01:46:25.463205 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":73,"threads_started":1}
I20260810 01:46:25.466115 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18215
I20260810 01:46:25.480348 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18334
I20260810 01:46:25.490839 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18449
2026-08-10T01:46:25Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3147 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 01:46:25 dist-test-slave-jlzn krb5kdc[18813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 01:46:25 dist-test-slave-jlzn krb5kdc[18813](info): set up 2 sockets
Aug 10 01:46:25 dist-test-slave-jlzn krb5kdc[18813](info): commencing operation
krb5kdc: starting...
W20260810 01:46:26.623319 16617 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/test-user.keytab.
Aug 10 01:46:26 dist-test-slave-jlzn krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T01:46:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T01:46:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.16.58.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
Entry for principal kudu/127.16.58.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab.
I20260810 01:46:26.736747 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35793
--webserver_interface=127.16.58.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:43811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:35793,127.16.58.125:38483,127.16.58.124:42567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 01:46:26.844259 18831 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:46:26.844545 18831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:26.844580 18831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:26.844650 18831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:26.848546 18831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:26.848594 18831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:26.848619 18831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:26.848649 18831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:26.848677 18831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:26.853775 18831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:35793,127.16.58.125:38483,127.16.58.124:42567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.126.keytab
--principal=kudu/127.16.58.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.126:35793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.58.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:26.854776 18831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:26.855754 18831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:26.864019 18839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:26.864109 18841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:26.864012 18844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:26.864459 18831 server_base.cc:1034] running on GCE node
I20260810 01:46:26.865097 18831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:26.866349 18831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:26.867519 18831 hybrid_clock.cc:648] HybridClock initialized: now 1786326386867493 us; error 39 us; skew 500 ppm
Aug 10 01:46:26 dist-test-slave-jlzn krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326386, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:26.870955 18831 init.cc:377] Logged in from keytab as kudu/127.16.58.126@KRBTEST.COM (short username kudu)
I20260810 01:46:26.872008 18831 webserver.cc:460] Webserver started at http://127.16.58.126:43583/ using document root <none> and password file <none>
I20260810 01:46:26.872552 18831 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:26.872619 18831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:26.872814 18831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:26.874785 18831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/data/instance:
uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae"
format_stamp: "Formatted at 2026-08-10 01:46:26 on dist-test-slave-jlzn"
server_key: "96893400de64e137666124ab1eb61633"
server_key_iv: "3bc0919f3a95fafbb7f0d3fe618ccc38"
server_key_version: "encryptionkey@0"
I20260810 01:46:26.875342 18831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/wal/instance:
uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae"
format_stamp: "Formatted at 2026-08-10 01:46:26 on dist-test-slave-jlzn"
server_key: "96893400de64e137666124ab1eb61633"
server_key_iv: "3bc0919f3a95fafbb7f0d3fe618ccc38"
server_key_version: "encryptionkey@0"
I20260810 01:46:26.878827 18831 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260810 01:46:26.881076 18854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:26.882210 18831 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:46:26.882332 18831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/wal
uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae"
format_stamp: "Formatted at 2026-08-10 01:46:26 on dist-test-slave-jlzn"
server_key: "96893400de64e137666124ab1eb61633"
server_key_iv: "3bc0919f3a95fafbb7f0d3fe618ccc38"
server_key_version: "encryptionkey@0"
I20260810 01:46:26.882421 18831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:26.909255 18831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:26.911964 18831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:26.912143 18831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:26.918916 18831 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.126:35793
I20260810 01:46:26.919206 18941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.126:35793 every 8 connection(s)
I20260810 01:46:26.919865 18831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/data/info.pb
I20260810 01:46:26.922096 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18831
I20260810 01:46:26.922215 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-0/wal/instance
I20260810 01:46:26.922477 16617 external_mini_cluster.cc:1428] Setting key bca31e2af44ecb1d4c4b0e81349c3c19
I20260810 01:46:26.922652 18942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:26.927080 18942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.58.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.125@KRBTEST.COM" created.
Aug 10 01:46:26 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326386, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:46:26.942945 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:26.929749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35793 (local address 127.0.0.1:51434)
0810 01:46:26.930324 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:26.930376 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:26.931229 (+ 853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:26.932073 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:26.932078 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:26.932448 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:26.932708 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:26.932721 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:26.934134 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:26.934138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:26.935094 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:26.935105 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:26.935781 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:26.935786 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:26.935915 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:26.936470 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:26.936491 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:26.938222 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:26.940301 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:26.940310 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:26.940318 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:26.940536 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:26.940885 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:26.940887 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:26.940888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:26.940990 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:26.941688 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:26.941693 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:26.941809 (+ 116us) client_negotiation.cc:769] Sending connection context
0810 01:46:26.941936 (+ 127us) client_negotiation.cc:240] Negotiation successful
0810 01:46:26.942189 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":137,"threads_started":1}
I20260810 01:46:26.942948 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:26.930656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51434 (local address 127.16.58.126:35793)
0810 01:46:26.930966 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:26.930977 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:26.931023 (+ 46us) server_negotiation.cc:407] Connection header received
0810 01:46:26.931556 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:26.931563 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:26.931861 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:26.932083 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:26.932840 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:26.934006 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:26.935207 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:26.935612 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:26.935744 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:26.938357 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:26.938364 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:26.938376 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:26.938401 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:26.940199 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:26.940647 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:26.940653 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:26.940655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:26.940798 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:26.941070 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:26.941073 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:26.941075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:26.941576 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:26.941722 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:26.942043 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 01:46:26.942294 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":202,"thread_start_us":91,"threads_started":1}
I20260810 01:46:26.945361 18942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:46:26.946029 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:26.945795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:38483 (local address 127.0.0.1:60032)
0810 01:46:26.945894 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:26.945961 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 01:46:26.946257 18855 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
I20260810 01:46:26.947032 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:26.946849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:38483 (local address 127.0.0.1:60038)
0810 01:46:26.946939 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:26.946983 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 01:46:26.947153 18942 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.125:38483: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab.
Entry for principal kudu/127.16.58.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab.
I20260810 01:46:26.950043 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.125:38483
--webserver_interface=127.16.58.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab
--principal=kudu/127.16.58.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:43811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:35793,127.16.58.125:38483,127.16.58.124:42567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:46:26.996385 18942 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } attempt: 1
I20260810 01:46:26.997169 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:26.996878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:38483 (local address 127.0.0.1:60052)
0810 01:46:26.997014 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:26.997074 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 01:46:26.997900 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:26.997699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:38483 (local address 127.0.0.1:60054)
0810 01:46:26.997795 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:26.997841 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 01:46:26.998034 18942 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.125:38483: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
W20260810 01:46:27.058246 18954 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:46:27.058502 18954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:27.058535 18954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:27.058593 18954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:27.062477 18954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:27.062527 18954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:27.062546 18954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:27.062561 18954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:27.062588 18954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:27.066169 18942 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } attempt: 2
I20260810 01:46:27.066959 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.066675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:38483 (local address 127.0.0.1:60056)
0810 01:46:27.066815 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.066877 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 01:46:27.067592 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.067401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:38483 (local address 127.0.0.1:60064)
0810 01:46:27.067488 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.067532 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 01:46:27.067711 18942 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.125:38483: Network error: Client connection negotiation failed: client connection to 127.16.58.125:38483: connect: Connection refused (error 111)
I20260810 01:46:27.068060 18954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:35793,127.16.58.125:38483,127.16.58.124:42567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.125.keytab
--principal=kudu/127.16.58.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.125:38483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.16.58.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:27.069034 18954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:27.069984 18954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 01:46:27.078151 18954 server_base.cc:1034] running on GCE node
W20260810 01:46:27.078085 18966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:27.078125 18962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:27.078088 18963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:27.078871 18954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:27.079929 18954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:27.081089 18954 hybrid_clock.cc:648] HybridClock initialized: now 1786326387081067 us; error 34 us; skew 500 ppm
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326387, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:27.083604 18954 init.cc:377] Logged in from keytab as kudu/127.16.58.125@KRBTEST.COM (short username kudu)
I20260810 01:46:27.084448 18954 webserver.cc:460] Webserver started at http://127.16.58.125:39075/ using document root <none> and password file <none>
I20260810 01:46:27.084959 18954 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:27.085024 18954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:27.085206 18954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:27.087230 18954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/data/instance:
uuid: "8a7317171a224540be64b5eceba98aab"
format_stamp: "Formatted at 2026-08-10 01:46:27 on dist-test-slave-jlzn"
server_key: "3cbc35d81d1fe451d0da83b06c50a425"
server_key_iv: "6ef2db8fd52d0190275980d87bb38fad"
server_key_version: "encryptionkey@0"
I20260810 01:46:27.087751 18954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/wal/instance:
uuid: "8a7317171a224540be64b5eceba98aab"
format_stamp: "Formatted at 2026-08-10 01:46:27 on dist-test-slave-jlzn"
server_key: "3cbc35d81d1fe451d0da83b06c50a425"
server_key_iv: "6ef2db8fd52d0190275980d87bb38fad"
server_key_version: "encryptionkey@0"
I20260810 01:46:27.091086 18954 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 01:46:27.093267 18979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:27.094336 18954 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:46:27.094445 18954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/wal
uuid: "8a7317171a224540be64b5eceba98aab"
format_stamp: "Formatted at 2026-08-10 01:46:27 on dist-test-slave-jlzn"
server_key: "3cbc35d81d1fe451d0da83b06c50a425"
server_key_iv: "6ef2db8fd52d0190275980d87bb38fad"
server_key_version: "encryptionkey@0"
I20260810 01:46:27.094532 18954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:27.102658 18954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:27.105051 18954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:27.105207 18954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:27.111521 18954 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.125:38483
I20260810 01:46:27.111764 19067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.125:38483 every 8 connection(s)
I20260810 01:46:27.112448 18954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/data/info.pb
I20260810 01:46:27.115077 19069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:27.115921 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 18954
I20260810 01:46:27.116036 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-1/wal/instance
I20260810 01:46:27.116307 16617 external_mini_cluster.cc:1428] Setting key 16961ff23735ce7bfaf0a99a467a8e0f
I20260810 01:46:27.119045 19069 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.16.58.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.16.58.124@KRBTEST.COM" created.
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326387, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:46:27.132983 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.121055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51448 (local address 127.16.58.126:35793)
0810 01:46:27.121196 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.121200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.122170 (+ 970us) server_negotiation.cc:407] Connection header received
0810 01:46:27.123042 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.123046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.123107 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.123185 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.124344 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.124866 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.125997 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.126238 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.126329 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.128770 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.128773 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.128775 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.128801 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.130842 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.131343 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.131348 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.131350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.131450 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.131838 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.131842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.131844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.132078 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.132187 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.132672 (+ 485us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.132806 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 01:46:27.133687 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.121541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35793 (local address 127.0.0.1:51448)
0810 01:46:27.122023 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.122064 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:27.122847 (+ 783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:27.123353 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:27.123360 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:27.123707 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:27.124201 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.124213 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.124985 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.124989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.125874 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.125884 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.126378 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.126382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.126542 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.127060 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:27.127077 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:27.128586 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:27.130970 (+ 2384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.130975 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.130987 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.131242 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.131552 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.131554 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.131556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.131712 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.132174 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:27.132178 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:27.132413 (+ 235us) client_negotiation.cc:769] Sending connection context
0810 01:46:27.132567 (+ 154us) client_negotiation.cc:240] Negotiation successful
0810 01:46:27.132821 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":128,"threads_started":1}
I20260810 01:46:27.135040 19069 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326387, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.16.58.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab.
Entry for principal kudu/127.16.58.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab.
I20260810 01:46:27.142375 16617 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskouGL2L/build/debug/bin/kudu
/tmp/dist-test-taskouGL2L/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.124:42567
--webserver_interface=127.16.58.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab
--principal=kudu/127.16.58.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.16.58.84:43811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.58.126:35793,127.16.58.125:38483,127.16.58.124:42567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 01:46:27.143539 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.135486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:38483 (local address 127.0.0.1:60070)
0810 01:46:27.135629 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.135641 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:27.135697 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:27.136245 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:27.136248 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:27.136397 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:27.136477 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.136482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.137397 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.137400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.137924 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.137932 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.138460 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.138464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.138561 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.138940 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:27.138951 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:27.140145 (+ 1194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:27.141987 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.141990 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.141992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.142250 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.142498 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.142501 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.142503 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.142595 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.143024 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:27.143026 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:27.143125 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 01:46:27.143242 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 01:46:27.143364 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":2}
I20260810 01:46:27.143558 19080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.135600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60070 (local address 127.16.58.125:38483)
0810 01:46:27.135934 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.135943 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.135960 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:46:27.135992 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.135996 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.136133 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.136246 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.136572 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.137295 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.138023 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.138362 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.138450 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.140281 (+ 1831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.140291 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.140302 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.140324 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.141887 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.142343 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.142347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.142348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.142416 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.142685 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.142689 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.142691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.142931 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.143030 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.143309 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.143423 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":130,"threads_started":1}
I20260810 01:46:27.145373 19069 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:46:27.146020 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.145790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44428)
0810 01:46:27.145897 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.145965 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 01:46:27.146185 18983 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
I20260810 01:46:27.146950 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.146746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44444)
0810 01:46:27.146856 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.146901 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260810 01:46:27.147074 19069 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:42567: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
I20260810 01:46:27.158854 18942 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } attempt: 3
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326386, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
I20260810 01:46:27.167227 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.159282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:38483 (local address 127.0.0.1:60080)
0810 01:46:27.159403 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.159417 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:27.159495 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:27.159732 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:27.159734 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:27.159924 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:27.160029 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.160035 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.161044 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.161047 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.161589 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.161596 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.162170 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.162172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.162247 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.162703 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:27.162713 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:27.164089 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:27.165903 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.165906 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.165907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.166093 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.166355 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.166357 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.166358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.166426 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.166802 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:27.166804 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:27.166892 (+ 88us) client_negotiation.cc:769] Sending connection context
0810 01:46:27.166967 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 01:46:27.167098 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 01:46:27.167332 19080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.159345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60080 (local address 127.16.58.125:38483)
0810 01:46:27.159461 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.159466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.159483 (+ 17us) server_negotiation.cc:407] Connection header received
0810 01:46:27.159574 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.159577 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.159623 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.159726 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.160131 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.160949 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.161693 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.162073 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.162178 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.164228 (+ 2050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.164233 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.164235 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.164263 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.165796 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.166178 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.166181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.166183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.166281 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.166496 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.166499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.166501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.166723 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.166824 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.167069 (+ 245us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.167188 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:46:27.168404 18942 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:46:27.169106 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.168878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44460)
0810 01:46:27.168995 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.169042 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 01:46:27.169811 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.169575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44470)
0810 01:46:27.169715 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.169759 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260810 01:46:27.169930 18942 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:42567: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
I20260810 01:46:27.196319 19069 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } attempt: 1
I20260810 01:46:27.197079 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.196815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44472)
0810 01:46:27.196948 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.197003 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 01:46:27.197791 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.197591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44480)
0810 01:46:27.197688 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.197736 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 01:46:27.197906 19069 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:42567: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
I20260810 01:46:27.201066 18942 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } attempt: 1
I20260810 01:46:27.201623 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.201395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44488)
0810 01:46:27.201511 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.201557 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 01:46:27.202267 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.202078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44498)
0810 01:46:27.202174 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.202218 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 01:46:27.202373 18942 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:42567: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
W20260810 01:46:27.256953 19081 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 01:46:27.257228 19081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 01:46:27.257263 19081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 01:46:27.257318 19081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 01:46:27.261353 19081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 01:46:27.261409 19081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 01:46:27.261433 19081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 01:46:27.261454 19081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 01:46:27.261482 19081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 01:46:27.266052 19069 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } attempt: 2
I20260810 01:46:27.266808 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.266526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44508)
0810 01:46:27.266670 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.266728 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 01:46:27.266970 19081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.58.84:43811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.16.58.126:35793,127.16.58.125:38483,127.16.58.124:42567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/krb5kdc/kudu_127.16.58.124.keytab
--principal=kudu/127.16.58.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.58.124:42567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.16.58.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 00:50:46 UTC on ccycloud.quasar-rjxzeq.root.comops.site
build id 4576866
I20260810 01:46:27.267534 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.267325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44512)
0810 01:46:27.267431 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.267476 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 01:46:27.267653 19069 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:42567: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
I20260810 01:46:27.268062 19081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 01:46:27.269029 19081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 01:46:27.277357 19091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:27.277529 19081 server_base.cc:1034] running on GCE node
I20260810 01:46:27.277503 18942 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } attempt: 2
W20260810 01:46:27.277357 19092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 01:46:27.277377 19098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 01:46:27.278213 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.277936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44514)
0810 01:46:27.278058 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.278111 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 01:46:27.278427 19081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 01:46:27.278903 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.278691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44530)
0810 01:46:27.278800 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.278846 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 01:46:27.279036 18942 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.16.58.124:42567: Network error: Client connection negotiation failed: client connection to 127.16.58.124:42567: connect: Connection refused (error 111)
I20260810 01:46:27.279578 19081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 01:46:27.280747 19081 hybrid_clock.cc:648] HybridClock initialized: now 1786326387280721 us; error 34 us; skew 500 ppm
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326387, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 01:46:27.283367 19081 init.cc:377] Logged in from keytab as kudu/127.16.58.124@KRBTEST.COM (short username kudu)
I20260810 01:46:27.284255 19081 webserver.cc:460] Webserver started at http://127.16.58.124:46147/ using document root <none> and password file <none>
I20260810 01:46:27.284770 19081 fs_manager.cc:359] Metadata directory not provided
I20260810 01:46:27.284827 19081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 01:46:27.284991 19081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 01:46:27.286976 19081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/data/instance:
uuid: "4cb52fe3c25d44f58a0a689301d2a6f6"
format_stamp: "Formatted at 2026-08-10 01:46:27 on dist-test-slave-jlzn"
server_key: "f15e2423b9dc515743e0108441b63ce9"
server_key_iv: "4801a1b8fb78815e4717c6a1705ddead"
server_key_version: "encryptionkey@0"
I20260810 01:46:27.287467 19081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/wal/instance:
uuid: "4cb52fe3c25d44f58a0a689301d2a6f6"
format_stamp: "Formatted at 2026-08-10 01:46:27 on dist-test-slave-jlzn"
server_key: "f15e2423b9dc515743e0108441b63ce9"
server_key_iv: "4801a1b8fb78815e4717c6a1705ddead"
server_key_version: "encryptionkey@0"
I20260810 01:46:27.290942 19081 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260810 01:46:27.293200 19112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 01:46:27.294305 19081 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260810 01:46:27.294409 19081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/data,/tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/wal
uuid: "4cb52fe3c25d44f58a0a689301d2a6f6"
format_stamp: "Formatted at 2026-08-10 01:46:27 on dist-test-slave-jlzn"
server_key: "f15e2423b9dc515743e0108441b63ce9"
server_key_iv: "4801a1b8fb78815e4717c6a1705ddead"
server_key_version: "encryptionkey@0"
I20260810 01:46:27.294490 19081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 01:46:27.310875 19081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 01:46:27.313481 19081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 01:46:27.313678 19081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 01:46:27.320848 19081 rpc_server.cc:307] RPC server started. Bound to: 127.16.58.124:42567
I20260810 01:46:27.321128 19186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.58.124:42567 every 8 connection(s)
I20260810 01:46:27.321771 19081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/data/info.pb
I20260810 01:46:27.324599 19187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 01:46:27.328354 19187 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:46:27.329025 16617 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskouGL2L/build/debug/bin/kudu as pid 19081
I20260810 01:46:27.329164 16617 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskouGL2L/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786326110151381-16617-0/minicluster-data/master-2/wal/instance
I20260810 01:46:27.329468 16617 external_mini_cluster.cc:1428] Setting key db740e0993f67b7d69ca3aae6b9c16c3
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326387, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
I20260810 01:46:27.341279 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.330415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51464 (local address 127.16.58.126:35793)
0810 01:46:27.330546 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.330551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.331403 (+ 852us) server_negotiation.cc:407] Connection header received
0810 01:46:27.332229 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.332232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.332282 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.332350 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.333297 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.333791 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.334845 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.335094 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.335172 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.337711 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.337714 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.337716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.337740 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.339147 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.339684 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.339686 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.339688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.339758 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.340104 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.340108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.340110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.340333 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.340434 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.340968 (+ 534us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.341115 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 01:46:27.342105 19192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.330691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.126:35793 (local address 127.0.0.1:51464)
0810 01:46:27.331252 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.331299 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:27.332018 (+ 719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:27.332417 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:27.332423 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:27.332873 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:27.333150 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.333164 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.333891 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.333895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.334727 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.334737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.335228 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.335232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.335408 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.336006 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:27.336028 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:27.337573 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:27.339252 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.339259 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.339268 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.339592 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.339849 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.339852 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.339854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.340000 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.340449 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:27.340453 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:27.340732 (+ 279us) client_negotiation.cc:769] Sending connection context
0810 01:46:27.340891 (+ 159us) client_negotiation.cc:240] Negotiation successful
0810 01:46:27.341193 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"spinlock_wait_cycles":57984,"thread_start_us":150,"threads_started":1}
I20260810 01:46:27.342104 19190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.330690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44536 (local address 127.16.58.124:42567)
0810 01:46:27.331139 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.331158 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.331200 (+ 42us) server_negotiation.cc:407] Connection header received
0810 01:46:27.332018 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.332042 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.332287 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.332446 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.333132 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.334089 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.334928 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.335380 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.335477 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.338117 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.338124 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.338136 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.338163 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.339780 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.340174 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.340179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.340180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.340249 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.340511 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.340514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.340515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.340800 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.340995 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.341203 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.341324 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":301,"thread_start_us":140,"threads_started":1}
I20260810 01:46:27.343255 19187 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326387, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.126@KRBTEST.COM
I20260810 01:46:27.350978 19080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.343863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60086 (local address 127.16.58.125:38483)
0810 01:46:27.343989 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.343993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.344015 (+ 22us) server_negotiation.cc:407] Connection header received
0810 01:46:27.344072 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.344074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.344117 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.344194 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.344609 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.345219 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.345979 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.346200 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.346272 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.348164 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.348168 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.348171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.348201 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.349493 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.349909 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.349912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.349913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.349987 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.350240 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.350243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.350245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.350413 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.350499 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.350769 (+ 270us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.350863 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 01:46:27.350980 19192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.343707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.125:38483 (local address 127.0.0.1:60086)
0810 01:46:27.343881 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.343894 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:27.343967 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:27.344210 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:27.344212 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:27.344372 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:27.344483 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.344490 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.345327 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.345330 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.345862 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.345871 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.346291 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.346294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.346389 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.346832 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:27.346843 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:27.348026 (+ 1183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:27.349599 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.349603 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.349605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.349819 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.350077 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.350080 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.350082 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.350158 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.350504 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:27.350507 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:27.350595 (+ 88us) client_negotiation.cc:769] Sending connection context
0810 01:46:27.350690 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 01:46:27.350818 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260810 01:46:27.351688 19187 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } has no permanent_uuid. Determining permanent_uuid...
I20260810 01:46:27.352264 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.344405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51476 (local address 127.16.58.126:35793)
0810 01:46:27.344504 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.344506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.344517 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:46:27.344617 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.344620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.344663 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.344738 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.345220 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.345720 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.346565 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.346864 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.346939 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.349280 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.349283 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.349285 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.349306 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.350578 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.351007 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.351011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.351013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.351100 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.351416 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.351420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.351421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.351629 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.351878 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.352008 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.352117 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326387, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.124@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.16.58.125@KRBTEST.COM
I20260810 01:46:27.358785 19069 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } attempt: 3
I20260810 01:46:27.359874 19192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.352145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44538)
0810 01:46:27.352227 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.352240 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:27.352307 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:27.352807 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:27.352810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:27.352967 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:27.353039 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.353052 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.353891 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.353894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.354384 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.354392 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.354812 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.354816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.354893 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.355264 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:27.355274 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:27.356467 (+ 1193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:27.358360 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.358362 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.358364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.358527 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.358768 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.358771 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.358773 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.358848 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.359328 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:27.359330 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:27.359409 (+ 79us) client_negotiation.cc:769] Sending connection context
0810 01:46:27.359505 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 01:46:27.359621 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":1}
I20260810 01:46:27.359906 19190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.352263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44538 (local address 127.16.58.124:42567)
0810 01:46:27.352645 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.352648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.352659 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:46:27.352687 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.352689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.352721 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.352784 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.353151 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.353802 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.354485 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.354721 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.354802 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.356595 (+ 1793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.356598 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.356599 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.356621 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.357981 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.358616 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.358620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.358621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.358691 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.359005 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.359007 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.359009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.359210 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.359296 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.359579 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.359696 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314}
I20260810 01:46:27.361915 19080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.353365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60100 (local address 127.16.58.125:38483)
0810 01:46:27.353477 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.353480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.353494 (+ 14us) server_negotiation.cc:407] Connection header received
0810 01:46:27.353526 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.353529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.353576 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.353643 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.354132 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.354605 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.355420 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.355642 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.355723 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.358142 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.358145 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.358146 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.358167 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.360294 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.360753 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.360757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.360759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.360844 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.361151 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.361153 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.361154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.361323 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.361549 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.361675 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.361776 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326387, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.125@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
I20260810 01:46:27.363752 19187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6: Bootstrap starting.
I20260810 01:46:27.365268 16617 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 01:46:27.366832 19187 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:27.367477 19074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.359160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44548)
0810 01:46:27.359270 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.359284 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:27.359350 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:27.359774 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:27.359777 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:27.359965 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:27.360064 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.360072 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.361092 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.361095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.361795 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.361805 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.362387 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.362390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.362475 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.362870 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:27.362884 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:27.364220 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:27.366055 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.366059 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.366061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.366275 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.366550 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.366553 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.366555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.366635 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.367011 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:27.367014 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:27.367107 (+ 93us) client_negotiation.cc:769] Sending connection context
0810 01:46:27.367192 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 01:46:27.367320 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":1}
I20260810 01:46:27.367530 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.359210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44548 (local address 127.16.58.124:42567)
0810 01:46:27.359534 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.359552 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.359564 (+ 12us) server_negotiation.cc:407] Connection header received
0810 01:46:27.359592 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.359594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.359631 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.359843 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.360177 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.360979 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.361922 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.362263 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.362357 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.364363 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.364367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.364369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.364392 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.365916 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.366367 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.366370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.366372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.366457 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.366715 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.366718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.366720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.366923 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.367017 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.367257 (+ 240us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.367364 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":114,"threads_started":1}
I20260810 01:46:27.366377 18895 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51476
I20260810 01:46:27.367723 19187 log.cc:824] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:27.369912 19187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6: No bootstrap required, opened a new log
I20260810 01:46:27.370009 19069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab: Bootstrap starting.
I20260810 01:46:27.372136 19069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:27.372838 19069 log.cc:824] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:27.373786 19187 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } }
I20260810 01:46:27.373980 19187 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb52fe3c25d44f58a0a689301d2a6f6, State: Initialized, Role: FOLLOWER
I20260810 01:46:27.374259 19187 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } }
I20260810 01:46:27.374701 19199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.374845 19199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:27.374872 19069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab: No bootstrap required, opened a new log
I20260810 01:46:27.375521 19187 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:27.378147 18942 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } attempt: 3
I20260810 01:46:27.378448 19069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } }
I20260810 01:46:27.378685 19069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7317171a224540be64b5eceba98aab, State: Initialized, Role: FOLLOWER
I20260810 01:46:27.378978 19069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } }
I20260810 01:46:27.380236 19069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [sys.catalog]: configured and running, proceeding with master startup.
W20260810 01:46:27.380388 19214 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:27.380448 19214 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:27.378892 19081 master_runner.cc:186] Error getting master registration for 127.16.58.126:35793: OK, instance_id { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" instance_seqno: 1786326386917146 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:46:27.382531 19081 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 01:46:27.382814 19216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.382934 19216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [sys.catalog]: This master's current role is: FOLLOWER
Aug 10 01:46:27 dist-test-slave-jlzn krb5kdc[18813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786326386, etypes {rep=17 tkt=17 ses=17}, kudu/127.16.58.126@KRBTEST.COM for kudu/127.16.58.124@KRBTEST.COM
I20260810 01:46:27.383771 18954 master_runner.cc:186] Error getting master registration for 127.16.58.126:35793: OK, instance_id { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" instance_seqno: 1786326386917146 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 01:46:27.387466 18954 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 01:46:27.387666 19234 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:27.387756 19234 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:27.388474 18949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.378517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.16.58.124:42567 (local address 127.0.0.1:44564)
0810 01:46:27.378767 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 01:46:27.378781 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 01:46:27.378853 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 01:46:27.379448 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 01:46:27.379452 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 01:46:27.379652 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0810 01:46:27.379764 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.379771 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.380979 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.380995 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.381800 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 01:46:27.381811 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.382579 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.382583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 01:46:27.382670 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.383190 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 01:46:27.383206 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 01:46:27.384746 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 01:46:27.386731 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.386734 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.386736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.387018 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.387357 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 01:46:27.387361 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 01:46:27.387363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 01:46:27.387460 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 01:46:27.387960 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 01:46:27.387963 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 01:46:27.388067 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 01:46:27.388171 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 01:46:27.388305 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170}
I20260810 01:46:27.388969 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.379002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44564 (local address 127.16.58.124:42567)
0810 01:46:27.379100 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.379103 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.379114 (+ 11us) server_negotiation.cc:407] Connection header received
0810 01:46:27.379154 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.379157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.379196 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.379259 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.379999 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.380778 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.381947 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.382293 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.382389 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.384895 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.384898 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.384901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.384924 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.386574 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.387154 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.387157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.387159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.387249 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.387565 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.387568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.387570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.387791 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.387915 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.388688 (+ 773us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.388811 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 01:46:27.391506 18942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae: Bootstrap starting.
I20260810 01:46:27.393587 18942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae: Neither blocks nor log segments found. Creating new log.
I20260810 01:46:27.394260 18942 log.cc:824] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae: Log is configured to *not* fsync() on all Append() calls
I20260810 01:46:27.396345 18942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae: No bootstrap required, opened a new log
I20260810 01:46:27.399470 18942 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } }
I20260810 01:46:27.399684 18942 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7c944c624d4fe88a5e33c8bb4fe0ae, State: Initialized, Role: FOLLOWER
I20260810 01:46:27.400025 18942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } }
I20260810 01:46:27.400610 19239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.400859 19239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:27.401328 18942 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [sys.catalog]: configured and running, proceeding with master startup.
I20260810 01:46:27.401408 18895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 01:46:27.401517 18895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:27.402809 18895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } }
I20260810 01:46:27.403745 18895 leader_election.cc:288] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [CANDIDATE]: Term 1 election: Requested vote from peers 8a7317171a224540be64b5eceba98aab (127.16.58.125:38483), 4cb52fe3c25d44f58a0a689301d2a6f6 (127.16.58.124:42567)
I20260810 01:46:27.404578 19152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6"
I20260810 01:46:27.404809 19152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:27.405170 19023 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8a7317171a224540be64b5eceba98aab"
I20260810 01:46:27.405383 19023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [term 0 FOLLOWER]: Advancing to term 1
I20260810 01:46:27.406080 19152 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7c944c624d4fe88a5e33c8bb4fe0ae in term 1.
I20260810 01:46:27.406582 19023 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7c944c624d4fe88a5e33c8bb4fe0ae in term 1.
I20260810 01:46:27.406649 18857 leader_election.cc:302] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7c944c624d4fe88a5e33c8bb4fe0ae, 4cb52fe3c25d44f58a0a689301d2a6f6; no voters:
I20260810 01:46:27.407004 19239 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [term 1 FOLLOWER]: Leader election won for term 1
I20260810 01:46:27.407620 19239 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [term 1 LEADER]: Becoming Leader. State: Replica: 2e7c944c624d4fe88a5e33c8bb4fe0ae, State: Running, Role: LEADER
I20260810 01:46:27.408013 19239 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } }
I20260810 01:46:27.409833 19239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e7c944c624d4fe88a5e33c8bb4fe0ae. Latest consensus state: current_term: 1 leader_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.409989 19239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:27.413306 18831 master_runner.cc:263] No leader master found from master 2e7c944c624d4fe88a5e33c8bb4fe0ae
I20260810 01:46:27.413376 18831 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260810 01:46:27.413576 18861 tablet.cc:2369] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 01:46:27.414662 19253 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 01:46:27.414732 19253 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 01:46:27.425194 19080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.415155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60110 (local address 127.16.58.125:38483)
0810 01:46:27.415283 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.415288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.415457 (+ 169us) server_negotiation.cc:407] Connection header received
0810 01:46:27.415657 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.415661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.415714 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.415766 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.416809 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.417574 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.418721 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.419043 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.419117 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.421230 (+ 2113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.421235 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.421238 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.421266 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.423200 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.423728 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.423732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.423734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.423858 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.424188 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.424191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.424193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.424406 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.424518 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.424912 (+ 394us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.425030 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 01:46:27.425194 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.415638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44568 (local address 127.16.58.124:42567)
0810 01:46:27.415743 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.415746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.416681 (+ 935us) server_negotiation.cc:407] Connection header received
0810 01:46:27.416838 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.416840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.416884 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.416938 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.417833 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.418577 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.419582 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.419919 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.420007 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.421545 (+ 1538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.421548 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.421551 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.421577 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.423130 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.423728 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.423732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.423734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.423851 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.424188 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.424191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.424193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.424406 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.424518 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.424912 (+ 394us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.425035 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 01:46:27.428162 19263 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 01:46:27.429121 19263 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 01:46:27.434038 18950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:27.416077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51486 (local address 127.16.58.126:35793)
0810 01:46:27.416185 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.416189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.426795 (+ 10606us) server_negotiation.cc:407] Connection header received
0810 01:46:27.426992 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.426995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.427046 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.427110 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.427685 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.428240 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.428941 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:27.429161 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:27.429252 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:27.430480 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 01:46:27.430484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 01:46:27.430487 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 01:46:27.430513 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 01:46:27.431978 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.432445 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.432449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.432451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.432545 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 01:46:27.432830 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 01:46:27.432833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 01:46:27.432835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 01:46:27.433052 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 01:46:27.433170 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:27.433769 (+ 599us) server_negotiation.cc:299] Negotiation successful
0810 01:46:27.433887 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 01:46:27.434806 19152 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [term 1 FOLLOWER]: Refusing update from remote peer 2e7c944c624d4fe88a5e33c8bb4fe0ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:46:27.435513 19239 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:46:27.436879 19023 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [term 1 FOLLOWER]: Refusing update from remote peer 2e7c944c624d4fe88a5e33c8bb4fe0ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 01:46:27.437471 19257 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 01:46:27.439461 19199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e7c944c624d4fe88a5e33c8bb4fe0ae. Latest consensus state: current_term: 1 leader_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.439584 19199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:27.443912 19216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e7c944c624d4fe88a5e33c8bb4fe0ae. Latest consensus state: current_term: 1 leader_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.444046 19216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:27.449515 19257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.449658 19257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:27.450937 19199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.451066 19199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:27.451575 19277 mvcc.cc:205] Tried to move back new op lower bound from 7316792882925961216 to 7316792882827014144. Current Snapshot: MvccSnapshot[applied={T|T < 7316792882925961216}]
I20260810 01:46:27.451771 19273 mvcc.cc:205] Tried to move back new op lower bound from 7316792882925961216 to 7316792882827014144. Current Snapshot: MvccSnapshot[applied={T|T < 7316792882925961216}]
I20260810 01:46:27.452468 19239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.452596 19239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae [sys.catalog]: This master's current role is: LEADER
I20260810 01:46:27.453596 19216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7c944c624d4fe88a5e33c8bb4fe0ae" member_type: VOTER last_known_addr { host: "127.16.58.126" port: 35793 } } peers { permanent_uuid: "8a7317171a224540be64b5eceba98aab" member_type: VOTER last_known_addr { host: "127.16.58.125" port: 38483 } } peers { permanent_uuid: "4cb52fe3c25d44f58a0a689301d2a6f6" member_type: VOTER last_known_addr { host: "127.16.58.124" port: 42567 } } }
I20260810 01:46:27.453715 19216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab [sys.catalog]: This master's current role is: FOLLOWER
I20260810 01:46:27.456941 19263 catalog_manager.cc:1347] Generated new cluster ID: 25daab7b3dbf47518e2ff9dda2dea36f
I20260810 01:46:27.457012 19263 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 01:46:27.492851 19263 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 01:46:27.494138 19263 catalog_manager.cc:1504] Loading token signing keys...
I20260810 01:46:27.507588 19263 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e7c944c624d4fe88a5e33c8bb4fe0ae: Generated new TSK 0
I20260810 01:46:27.508446 19263 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 01:46:27.539368 18950 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.536857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51498 (local address 127.16.58.126:35793)
0810 01:46:27.537002 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.537007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.538298 (+ 1291us) server_negotiation.cc:407] Connection header received
0810 01:46:27.538501 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.538505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.538556 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.538605 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.539229 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51498: BlockingRecv error: recv got EOF from 127.0.0.1:51498 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 01:46:27.540854 19193 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.537710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44578 (local address 127.16.58.124:42567)
0810 01:46:27.537853 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.537857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.539913 (+ 2056us) server_negotiation.cc:407] Connection header received
0810 01:46:27.540050 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.540053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.540109 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.540187 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.540727 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44578: BlockingRecv error: recv got EOF from 127.0.0.1:44578 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260810 01:46:27.541735 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.540299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60122 (local address 127.16.58.125:38483)
0810 01:46:27.540416 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.540420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.540810 (+ 390us) server_negotiation.cc:407] Connection header received
0810 01:46:27.540984 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.540987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.541037 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.541087 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.541606 (+ 519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60122: BlockingRecv error: recv got EOF from 127.0.0.1:60122 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 01:46:27.546015 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.544505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60138 (local address 127.16.58.125:38483)
0810 01:46:27.544601 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.544605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.545108 (+ 503us) server_negotiation.cc:407] Connection header received
0810 01:46:27.545314 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.545317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.545391 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.545441 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.545922 (+ 481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60138: BlockingRecv error: recv got EOF from 127.0.0.1:60138 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 01:46:27.550940 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.549460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60142 (local address 127.16.58.125:38483)
0810 01:46:27.549548 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.549552 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.550112 (+ 560us) server_negotiation.cc:407] Connection header received
0810 01:46:27.550279 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.550282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.550327 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.550373 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.550851 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60142: BlockingRecv error: recv got EOF from 127.0.0.1:60142 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260810 01:46:27.556383 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.554989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60144 (local address 127.16.58.125:38483)
0810 01:46:27.555080 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.555083 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.555511 (+ 428us) server_negotiation.cc:407] Connection header received
0810 01:46:27.555704 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.555707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.555753 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.555832 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.556299 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60144: BlockingRecv error: recv got EOF from 127.0.0.1:60144 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260810 01:46:27.564173 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.562548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60148 (local address 127.16.58.125:38483)
0810 01:46:27.562697 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.562701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.563195 (+ 494us) server_negotiation.cc:407] Connection header received
0810 01:46:27.563393 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.563396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.563444 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.563495 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.564076 (+ 581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60148: BlockingRecv error: recv got EOF from 127.0.0.1:60148 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260810 01:46:27.577097 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.574360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60150 (local address 127.16.58.125:38483)
0810 01:46:27.574455 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.574459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.576210 (+ 1751us) server_negotiation.cc:407] Connection header received
0810 01:46:27.576395 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.576398 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.576445 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.576493 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.576996 (+ 503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60150: BlockingRecv error: recv got EOF from 127.0.0.1:60150 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260810 01:46:27.597000 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.595467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60160 (local address 127.16.58.125:38483)
0810 01:46:27.595588 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.595592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.596208 (+ 616us) server_negotiation.cc:407] Connection header received
0810 01:46:27.596322 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.596325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.596373 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.596441 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.596887 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60160: BlockingRecv error: recv got EOF from 127.0.0.1:60160 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 01:46:27.632099 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.631023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60164 (local address 127.16.58.125:38483)
0810 01:46:27.631196 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.631200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.631261 (+ 61us) server_negotiation.cc:407] Connection header received
0810 01:46:27.631396 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.631399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.631447 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.631556 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.631973 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60164: BlockingRecv error: recv got EOF from 127.0.0.1:60164 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260810 01:46:27.699411 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.698229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60178 (local address 127.16.58.125:38483)
0810 01:46:27.698376 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.698381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.698579 (+ 198us) server_negotiation.cc:407] Connection header received
0810 01:46:27.698765 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.698768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.698822 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.698894 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.699281 (+ 387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60178: BlockingRecv error: recv got EOF from 127.0.0.1:60178 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260810 01:46:27.830713 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:27.829662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60186 (local address 127.16.58.125:38483)
0810 01:46:27.829813 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:27.829818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:27.829938 (+ 120us) server_negotiation.cc:407] Connection header received
0810 01:46:27.830064 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:27.830066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:27.830116 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:27.830190 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:27.830574 (+ 384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60186: BlockingRecv error: recv got EOF from 127.0.0.1:60186 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 01:46:28.089794 19080 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 01:46:28.088752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60198 (local address 127.16.58.125:38483)
0810 01:46:28.088889 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:28.088893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:28.089021 (+ 128us) server_negotiation.cc:407] Connection header received
0810 01:46:28.089152 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:28.089155 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:28.089206 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:28.089276 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 01:46:28.089667 (+ 391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60198: BlockingRecv error: recv got EOF from 127.0.0.1:60198 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 01:46:28.381752 19214 catalog_manager.cc:1259] Loaded cluster ID: 25daab7b3dbf47518e2ff9dda2dea36f
I20260810 01:46:28.381834 19214 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6: loading cluster ID for follower catalog manager: success
I20260810 01:46:28.383419 19214 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6: acquiring CA information for follower catalog manager: success
I20260810 01:46:28.384545 19214 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4cb52fe3c25d44f58a0a689301d2a6f6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:46:28.388868 19234 catalog_manager.cc:1259] Loaded cluster ID: 25daab7b3dbf47518e2ff9dda2dea36f
I20260810 01:46:28.388931 19234 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab: loading cluster ID for follower catalog manager: success
I20260810 01:46:28.390436 19234 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab: acquiring CA information for follower catalog manager: success
I20260810 01:46:28.391417 19234 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8a7317171a224540be64b5eceba98aab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 01:46:28.607755 19377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:28.603827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60202 (local address 127.16.58.125:38483)
0810 01:46:28.604059 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:28.604063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:28.604168 (+ 105us) server_negotiation.cc:407] Connection header received
0810 01:46:28.604329 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:28.604333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:28.604471 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:28.604575 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:28.604845 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.605372 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.606236 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.606468 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.606558 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:28.606881 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:28.607344 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:28.607459 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:28.607533 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 01:46:28.607590 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":70,"threads_started":1}
I20260810 01:46:28.613535 19384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:28.610473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44580 (local address 127.16.58.124:42567)
0810 01:46:28.610709 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:28.610712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:28.610725 (+ 13us) server_negotiation.cc:407] Connection header received
0810 01:46:28.610805 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:28.610807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:28.610908 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:28.610997 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:28.611131 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.611637 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.612394 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.612605 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.612684 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:28.612883 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:28.613224 (+ 341us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:28.613302 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:28.613346 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 01:46:28.613390 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":67,"threads_started":1}
I20260810 01:46:28.620134 19377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:28.616038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60216 (local address 127.16.58.125:38483)
0810 01:46:28.616134 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:28.616138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:28.616670 (+ 532us) server_negotiation.cc:407] Connection header received
0810 01:46:28.616791 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:28.616794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:28.616846 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:28.616911 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:28.617259 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.617964 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.618821 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.619157 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.619252 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:28.619669 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:28.619734 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:28.619828 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:28.619954 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 01:46:28.620004 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 01:46:28.620254 19384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:28.616317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44588 (local address 127.16.58.124:42567)
0810 01:46:28.616404 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:28.616408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:28.616563 (+ 155us) server_negotiation.cc:407] Connection header received
0810 01:46:28.616716 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:28.616719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:28.616763 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:28.616822 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:28.617171 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.617657 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.618859 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.619172 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.619252 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:28.619682 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:28.619739 (+ 57us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:28.619795 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:28.620081 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 01:46:28.620128 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 01:46:28.620630 19395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 01:46:28.616044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51510 (local address 127.16.58.126:35793)
0810 01:46:28.616308 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0810 01:46:28.616312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 01:46:28.616387 (+ 75us) server_negotiation.cc:407] Connection header received
0810 01:46:28.616549 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 01:46:28.616553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 01:46:28.616703 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 01:46:28.616818 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 01:46:28.616980 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.617794 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.618901 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 01:46:28.619132 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 01:46:28.619219 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 01:46:28.619497 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 01:46:28.619746 (+ 249us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 01:46:28.619893 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 01:46:28.620447 (+ 554us) server_negotiation.cc:299] Negotiation successful
0810 01:46:28.620501 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":96,"threads_started":1}
I20260810 01:46:28.623095 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18831
I20260810 01:46:28.643208 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 18954
I20260810 01:46:28.654276 16617 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskouGL2L/build/debug/bin/kudu with pid 19081
2026-08-10T01:46:28Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3163 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6310 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (278472 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST